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ABSTBACT 

The Alverno Ccllege faculty reports on its 
d^velopfflent and use of assessaent (rather than testing) to elicit,, 
diagnose, and certify student abilities as part of its 
cutcooe-centered approach to liberal education. Assessaent is defii:ed 
as a More coaplete challenge tc both the process and the content of u 
student's learning, achieving a sore personal, specific and 
integrated view of her develofing competence- The bcok raises several 
inrwirable questions (e.g., reliable observing, accurate saapling of 
a udent«s abilities, defining apFropriate criteria), and explains 
hot! the faculty of this small, urban Catholic ccllege for woaen 
, .discovered assessment as essential to their approach to liberal 
'learning- It is shown that the authore* view cf coafetence as- 
"generic," "developmental" and "holistic" reguires certain qualities 
in each Alverno assessment technique. Hays iu which faculty aeabers 
design assessaent s are deaonstrated, as well as how assessors are 
recruited and trained. In one chapter, students reflect on the 
, experience of being assessed and learning to assess. A final chapter 
reviews the elements of the ccllege' s assessaent system, an4 
assessment's impact on the faculty. The book repeatedly stresses 
beginning with a clear focus en the outcomes to be assessed, in 
developing individual techniques or an overall systcE. It is 
eaphasized that assessment is a learning experience for students and 
faculty alike. (Author/LEH) 
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I How Ntfe Define and Wh/>/b Do Aaessmenf 



To assess. This term, which at its simplest 
means to observe ?nd to judge som^hing, is 
I one of the most visible results of what has 
been called a "Copernican revolution" in 
education.* 

Today, most Amefican educators woiild 
probably agree that the learner — not the 
teacher — Is at the center of thr educational 
universe. In the lant few decades, however, 
growing numbers of educators have seriously 
set about translating the modern consensu*^ 
into action. In varying ways, they have 
undertaken the task of helping learners tearn 
certain processes — how to seek out, 
integrate and use knowledge — rather than 
simply passing along the body of knowledge 
itself. 



Education, so underwood, can fwer be 
adequately evaluated by b'aditional teeing. 
Narrow, one-dinwiisional probes into a 
student s mines ot ^ored informaticHi do not 
begin to get at how she learns or what she ' 
can do. Grades and curves, which sort 
students into groups for administrative 
handling, say nothing abcHJt how each one is 
using her talents or growing toward her 
potential. 

This new view of learning dwriands a broader 
yet more personal view of each learner's 
progress. Hence, assessment: a 
multidimensional attempt to observe :ind 
judge the individual learner in action. 




fund kyf thv Improwrnvnt nf Post Svctirni.ifs 



There are problems. To l^egin with, we must 
rety un sampling. A human being is a living 
mystery, only partly visible 1o another person. 
Yet even that- part would take more thran a - 
lifetime to rett^rcl. f rum the tens of thousands 
of hours of a studtMit's ctilk^e c aret^r, we can 
seiiHt but a handful for careful observation. 

.How do we know the sample is 
repre*.entative^ is the student having an 
unusually had (or g(KKl) day? N she simply 
showing her strong suit, or i.in ^he exhibit 
the same abihfu^s umkn diflorent 
cinum^tant es^ 



Then there is ob5.erv/ng^ Even the smalleiit ^ 
sample of human behavior is so ricKly 
complex that we ca* focus only on a few key 
dements. Which ones^ How do Sve record^ 
them^ Does the situation really call for them? 
DcH's it ri>strict the student to doing only what 
we are kxjking for, or does it challenge her ^ 
to shov. her J>est? 




SAMPLING 
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fiidffftg rai!«\tnore hard questions. How can 
we separate an intangible aBilily (like 
anaiysi!>) from Ihf activity (like writing) that 
make, it visible? Who shdtl judge? How do 
we assure some uniformity among sex^erat 
assessors? In judging we are applying criterid, 
How mljch dt'Hionstration of an ability is 
enough? What makes an "erfet live'' action? 
How are these and other criteria set? By . 
whom? 



Tliese questions are mA the kind thafhave ^ 
'fixed answers. To undertake assessnwit 
nutans sampling, observing and judging 
according to criteria. It nreans develc^ing a 
whole array of techniques, to take into 
account tfie fullest possible range of human 
tdlents. And it means an ongoing 
commifmef^ to dealing with these kinds of 
questions. 

The following pages record some of our 
exptoraficn into assessment at Alverno 
C ollege. We have acceptc^l the challenge 
Irk aust* it is full of promise. Already we are 
learning to ask more and bettei questions. 
We are developing a more solid ground for 
i'omparisons and evaluations, since 
iissessment is built on sp<*cific\l criteria. And 
wv are gaining more and more individualized 
|x>rtrails of e»K h learner's unique 
consirliatton of unfolding abilities, her 
^)ersonai style of learninK and doing. 
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We have made a major commiitnent to a 
assessment at Alverno Coilege, W& are , ^ * 
committed to assess what is l^ing taught in 
. every course in out curriculum. Indeed, we 
consider the assessn^nt techniques and 
criteria as important as the topics and texts 
of the courses. We are also committed to 
assessing studenj competence? outside the 
classrcK)m.' The Assefisment Center, with a 
/^uU-time staff a«d dozens of trained campus 
I and outside assessors, administers externa! 
assessments and evaluative feedback to 
students throughout the school year. 

This all came about as a direct result of our 
effort to define and bring into being a 
fundamentally new. approach to the age-old 
task of liberal education. We began this 
effort a decade ago, ir, the late 1 9bOs, when 
serious questions ^W4;je surfacing nattonwidi^ 
about the^m^aning ancKalue of college and 
of fiberaf induration in particular. At Alverno, 
these questions combined with our ne^ to 
redefine our mission as a small, urban 
Catholic liberal arts college for women. The 
result was a deep and serious inquiry into 
our goals and values as t*du(ators. 

After two years of special semmars, ftlculty 
institutes, student-faculty commissions and " 
rollege-vvide forums, our inquiry took more 
defijiite shape m a stnies of questions our 
president asked the academic departments 
in 1970^71: 



, • Wliat Ufidi of qwstem' ire JMag ^ " 

that rdate to the vaS^Kty of fom 
dkd^flkim in « toUrf o^ge prapaMf^ ^ 

• '*Vfiukt h d^wtiwafs poi£&i« 
on theftr 

• ''How are you dealing with thes^ 
probf^m in your generaf cffMa'Joii 
courses, Md in tl^ wirirfc for a major 
in your fieMr 

• ""What ar^ you leachif^ tfiat is sb 
important that sttiden^ cannot affofti 
to pass up courses in your 
department?" 



(Jhvjir'^t four /eve/s of each competence, 
rvquircd of every student in her general 
education program, are detailed in the 
diagram.) 
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During the en^^uing year of rationale 
pre&entaticHis by each ef d^artir^nts, 
the faculty reached a consensus that 
outcomes for the student are the 

^monsfrable value df any learning 
experience, '^What Mrfd of person," vve then 
asked ^'are we as educators ^king to 

^ d^eicx)? What outcomes or characteristics 
will sne need as part of herMifef in 
response to this question we developed the 
framework of jj series of eight general 
abiftties which, taken together, would result 
from a successful liberal eduiation. 



Jhese are: ' 

1, Effective communiatioittabNity 

2. Arutytkai cap^itity 
X Problem solving abUity 

4. Valuing in a decision making context*]; 

'-7 r 

* 5. Effective social interactton 

6. Eftediveness in imtividuai/envk^oivnent 
relatton^lps 

^ Re^onslblc involvement In the 
contemporary world 

8. Aenhetic responsiveness 




Nu um» ui wf realizinl, c ould Ik* 

taught or icamt»d diretlly in %^ single 
experience.- Nur ct>u!d thqy Ih» cJivortiHl 
from thi libdral arts (urfiiuium whkh 
they are the outcomes. The r.uulty t»K'rekjre 
evemually analy/ini inh h of tht»se abiltlie*' 
— which \sv called 'competences" — into J 
sequenc e of six levels at which the student 
\^puld Ih* expectcKl to demonstrate her 
abihlv as she* iKogrtsM.nf fhrou^^^i the 
und4»rgraduate c urf u iiiuni. 

We identitied thiNt* ^evels by evanuninK the 
t'xiMihg curric uiuni m eat h nt oui 
disiiplines IrtulituHvilly, each (iepartnu-nt 
had dtNcfihed its tuffic ulum a> a struc Uire 
of knaw lvii^r, \)\ KHiOffi^ wili? tiasii ^enrrdl 
rontepts ant) prti^nssinK !«i\v,Hd moM* 
ioniplei and sjun (dii/ed sluduw 1his (inuv' 
we worked tfon) tfv.* .issurnptfon fha! tfiert* is 
.ilsd a progtesston ol .ihihti^^ unplKit tf? thr 
movement trnrn' 'inlftuitH Inr v surves to 
.icivanied si-nnn^ir ihtt loc u^. liien, vn^^s to 
discern the dev*;lof)nienhil f).itiei.ns ,titiM(f\ 
embinlded in the nnrtii,}! tufntiilum of uijt 
disi»f>hnes. t.nhei than to riKirtinr'niii tu'kis 
Of lo i n\\\v a v\huU' new t iiifK ul.n 
structure. 



After we had identified these competences 
and their sequential levels, the quetition ' 
became; "How can v,/e tell how tapaforig a 
^iuclent is4n cieveloping tlu^se 
c omfH'tencesr' It wcjuld Ik* pointkss, we 
realized, to have spe-nt so muc h time and 
t»!toft artjculatmH our edu<vitional goals 
unless we wvtv v illing to make a similar 
investm*»n! m a«^sessmg their attainment. 
Ihus we afriv<»d ai assessnu»nt as a natural 
Mil inicial fjarl o! ouj approach to liberai ^ 
education, * 



W: How>^ Uhdersfand Aissessnnent 




.OnrJ wp had come to our purplj5.e as 
helping each student jJevelup her alitlitit*s, 
we nwied lo ask riol simply 'VVhaf dm*s 
*ht» kpcivvf" hut "What 4 an^ sht do with what 
she^knowsr This:tpd lo mmv diffKLll 
que>fions {han' \hv traditional 
pap<»r-afid-pennl tos>iqg mHh^xIs cauU) 
probe. Na lungt^r cobld we rdy on seeking 
right answers, or ask'ing Inr r('p<'titions and " 
reformulattons' oi mtKnori/o<j mformati<jn. 
Our assessment tet hmtfiMes would have to 
challenge <*ac h sUidi-nt to show her ^ 
•f '3*-^**'<'Pi'^^^ al)!htk»s in the best and hroadosf 
njannef'Ot Whuh sh<' was cap.^hle. 

••■ ■ J \ ' • ■ 

/)ur ou!(<mie < enieretl viev\^<)f e(Ju(at«)n 
also,! onsfdef.ihiv (UH»pt»ntHj oiTf • 
^ndt*fskindmg of the two « lassa tunt tiof^ ot 
* tiMinfr — *t(J ( r^iltMiti.d and ?o dfa\^nose. We 
-v^^uld ,nc*<'d iissi'ssfulMifs ifluii>i«' I'^oughfor ^ 
us to*stanii ac t ciunliUli) tin Iheni f)ftt)ft» 
oih4*r eduttifHr^ L^jth uitt^m .\m\ nutsule k\u\ 
totie^ei^Ve .ilsu wiiuld n^-tYTiis^t'^^nu-nls 
>ul/sttentiv speunt and detailed hu the - 
studtvit tu'f ifi^lrut |t)f% tt>'plan litT 
fiirfhef lfMrntn^%'\|)r{U'ni i's i*!li>{ tui K. \v\ 
we t ouki nnver alluhi U> lost* ^^uht tins 
yitiniate r^^^Min i\ vUv .isst»ssrn<'f\t to 



He tji^ 
W tilt- 



provfdejht- sludi'nl. .il't'.u h oi niain sJ«-|)\ 

anc< more ifuiivuiruii prntHus ot hrr {'fn^'f^mi; 
£ unihMiat«nfl oT ^itfs %kills ,intl stvlrs, sn th.jt 
sh<» can IXKotiH- an uidt-prndi^)! i**jnu'f. 
- ♦ * 

' FirtalK. h.*d < (»nir to I(k lis un nu!< omn** 
\ hv 4< k^o^^ led^fH^ tth^I, !r..Hn?n):'^ % tiue ^w-^ 

^ in .Its en^UiTHiM ^^npcU ! nr>nln ir.ii !)^m yl his $ 
rellet'ted (ujf lon^*- .fafulm^ ifilfnlion to 
tostei htiiiiN^ot n..nu*a«(i lU liun ih.U Nsouhj 
shape .mcl vph.mi'r oui ^tiidl•nt^ lives .jhd 

^nvuonnTTi;fts, V^f hcvorul \\\v toih-j^c 



h^.^, lo provide some asVurance th^t the / 
abilities a student shoWed v* e^ at some 
point bec ommg personahzed, part o\ her 
hia{)itua! way ot handlinjj-sUtatiuns in her 
pt^rsonal and sj>^ial as well as. her acader^ic 
and professional litq. . . w 

As these understandings j^r^v, we tcK)k hoJd 
oi ih'ei* terms that helpi?ii to summarise and 
guide vhal we were learntn^^. ^.Xir 
assessments hpd frf as rtearly js'Vve - ' 
iouid make them, generic, developmental 
and hoiistit ... 

Ihe sludent i cMiifietem t*s <hemse|ves are ^ 
, generic , rather th*^n ^^mply speVitK to a tast 

o? Mliiation They »5i<' »»linhulev 'or 
• chafaclerisfu^of ^Ke student herself. Whik» ' 
Ihey are ieaf^t»d and tleftuinstfate<i i|i 
sfu'i !tii settm'gs. these ^'n<»rif^ ahihtliN < an . 
In' tr jn*«terfiHi .uid nuxliiiec^^^ a v.;r;e?y of 
siiuafinns. . . , ^ • ' . 

BiHaii>e ot the jjenerie n*Ui re of the abilities* 
wtvare feat hi ng tor, therett'fe, our *• 

. assessments can and musi {Winuh entemat 
am^ nniltjplg. Both fhese quaitties help to 
, insure th.u tfu* abthfv a s/udent develops iru 
a given learning situalior', is a p.irl ot her 

(■ pt^fsf)niil retH^rtoire, i«*id ihM she tan 
<»\ert is(^ It in varying t«;ntt'\ts 

l\f<;fnailt\ appears in several ways. Tlie 
« nieo.i used t{) .issf^^ ^nr given 
( nf^<|M*ten( p level are <level<»ped nufsfde the 
p.Htu u',ji course getting iind ad.ipted for use 
in ihe «u hi.il asst^ssnn»nt Asst'*.> (irs ofti^n are 
tlMvMi iMiin (KJtside lliv ctass jntJ off 
(^.nnpus When Ihe sUuifnt .uid ifisffut t(jf. 
jH-ft: ^rnj^a- ,jssf*sso!s, ihes do m) v.ith a 
I I'A.nn ro4*' <lf**^'in( e tronv ttieii initi.ii 
nuoU<*inrnt in^lu- exeit istv 



V 
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Multiplicity occurs in requiring a single 
ability to be validated in severat settings, 
and in the constant use ot n$ultiple 
viewpoints — instructors and ta^plty 
co-assessors, off-campus a^isessors, peers 
artd self-ussessment. The use ut multiple 
assessne»its gives the student the 
opportunity and the obligation to seek 
certification in a variety of settings. In 
addition, she always has at least two sourti^s 
of judgment (herself and another assessor) 
and often several, trom a variety of 
backgrounds. 

Thus, for example, one part of eflective 
-ommunicnions is the ability to deliver^a 
complex spoken mess.ige to an unmitiat-tl 
audience. Attemptmg to denuinslrate this 
ability^ a student might well prepare and 
deliver a talk on c ar<)K)vascul.u ( ir^ ulati^m 
for an eighth-grade class. iSut h an exeri tse, 
we have found, provides a povserful tesi of 
how well she has "made hiu own ' the 
physiology oi Ihe heart and iilood vesseK, 
along with a sample o\ hvt speakmg ahHitie^ 
m aitton.) Hef physio^ogv mstructor and a 
Mimmunicafions mstructof would |oin in 
ludging.such speutK aiterfa as ofgam/at;on 
ithesis stateniera, supporting evident eh 
voice projetiion. and so on. later. lhi> 
siiidi^nt would reieive feedback <m the 
strengths and suti esses m her talk as wt 
the .ae,is ifi which -he next netuls to 
loncentiate her learning t^ttoft 



is 



But before the faculty can assert that On? ha* r 
made this ability a usable (»n of her H 
personal communication refwloire, a 
successful assessment (formally referred to at^ 
Aiverno as a ^-validation'*} must 1^ 
corroborated. She would also be required to 
deliver comparable complex spoken 
inessages successfully in other settings — 
say, before a simuiaU*d urban planning 
group and m a phiicjsophy seminar. . 

The assessments used to establish a given 
level of competence may vary widely. t>oth 
m the modes the student cwploys and in the 
methods of assessment. Demonstrating her - 
ability at a given level in analysis, for 
example, a student might find herself called 
uptm to draft and later etlit a written critique 
ot the sound and. image patterns in a poem, 
with her Inglish instructor and herself as 
assessors. She might ..itso work with a lab 
partner to isolate and identify a particular 
leli variety under a micros ope. with.herself 
and her partner, another iab te.mi and finally 
thi' bioiogv tn-.iui tor ass<H.sing the lab 
lournal. ^^ a later level, she might 
p.iftHipati* in an otf-<.mipus projett 
Kirntilying patterns tn labor gnevances and 
anatv/mg their underlying c a uses' for a targe 
m.mut.Hturum tirm. with the company's 
l.^lHH relations dtuM tor and hfr management 
jn^iuctor (oope^^itir^K as .issrssors. 
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We aiso understand competence in 
developmental terms. This means nc^ only 
• that competence l^els are sequenced in a 
. progressive tearn^ig pattern, but that we use 
assessment itself its a teaching tool. We do 
this by making assessment techniques and 
qfiterra Public and fXPftcH and by 

f presenting Ihe results to the student 
, immediately and in driaii in 4 stii^^^ n g^ 
feedback situation. 

At the beginning of each course, the 
instructor spells out the course goals in the 
* syllabus, including the competence levels a 
student may be ready to demonstrate as a 
result of the course expe'^ience. In th? 
J syllabus, the instructor relates the particular 
materials and assignments to the course 
goafs. The syllabus also specifies the 
assessment techniques that will be used, and 
enumerates the criteria upon which the 
students' work will be judged. 

fri an environmental psychology class, for 
example, students may 'seek validation in 
analysis at level 4 {"integrates patterns seen 

-in data to form conclusions") and in 

individual/environment relationships a! 
levels 3 and 4 ("sper^^ies the effects of a 
setting on human behavio:" and "designs 
alternate settings to solve ai environment 
.problem''). In weekiy field observations each 
student i<» required to record a given ^\le'^ 
influence on such variables as privacy or 
stress. This challenges her ability to identify 




environmental effects (environment^ tevel 3), - 
while required readings provide her with 
models for integrating what she observes 
and infers (analysis, tevel 4). 

The student must report orally on her field 
observations each week. Her instructor and 
fellow students asses3 her report, using such 
criJ ia as s|:^ific description of the setting, 
of the subjects, and of the behaviors 
observed, and clear articulation of how i}m 
inferred the setting's impact. Besides these 
weekly assessments, the student is also 
given larger, more formal assessment 
problems. Havirig read and discussed 
Edward Hall's The Hidden Dimension , for 
Instance, she is asked to design a cafeteria 
for the UN building, taking into account the 
wide differences Hall outlines in cultural 
sfiace/intimacy patterns. This exercise 
challenges her ability to projxjse 
environmental alternatives (environment, 
^evei 4). . - 

Whether or not she elects to attempt 
validation during the course, each student 
receives ongoing assessment, This gives both 
her and her instructor a diagnostic view of 
her learning progress. As soon as possible 
after each assessment, the student receives 
detailed feedback on her ^>erformance in 
terms of the overall course? goals and 
specific criteria set forth in the syllabus. 




!n the environmental pvycfiolo^y toufNe, 
feedback on the field work assessments is 
ioittantaneous (though the inslruitor may 
also st»t up an individual fet»dbac k session 
With a student he feels is havirn diflicultiet^i. 
On exercises hke the UN tafeieria design, 
the student miglit receive a detailed written 
annotation ot iier plan arid her cijanrams, 
and the class mtgfit engage in a group 
teedha«.k session as weli. Tl^e feedi)aik m,;v 
also address skills the stuciefit exlnbfls m 
collateral areas isuch as ^raphio^, aesthetus 
or social mtefaifuHi in her i^N caU'tena 
designs. e\en though they are rtt)t bei^ng 
validated m this i uutsv. 

Whether it tor v.ihdation or tor tliagfiosis 
alon(», whi'thcf it ts as simple .*s j simics oI 
one-par. igf.iph rt»sponM»s lu (|nes|inns a\h)u\ 
,\ nlni or as ( ofoplex tss presenting .i p*nk 
ust* plan to a neighborhood .isso( ijtinn. \\v 
try 1o use each as^t^ssnu'nl sftiuHion .is .{ 
ItMrnmg i*\pefUMKc. Uieailv, .^sst^sniefil 
sliotild contrif)ute to mm\ iiilminaie a 
j>nHi'-s ot witrknig tuw.ifd e\[j!tu!, knt>\iii 
goals, with irt'{]ui'nf siop^ to iiieasufi* tin- 
st,^{r ftt the aft" in^ ihi^ .jbihiv Uu» sliiHt-nt is 
wt>fking to <li'\rlup .md .ire working 

to lOstOf. 

As (jf ' ' most t{.Hiilu>nal U'slHig, nn 
iMenvM., M •-urpnsc Of se< it't \ TieotleH hi 
4issessnient. In Mit, we umi tlui^ , 
developnienl.U growth ilourishes uhef- ttie 
gtials and purposes ol ti'at fung, .Hong ^\{th 
tlu' te( linKjnes to? pnisumg thi^ni .ind 
nieasufrng (heir .u lut a enient, are ni.iHe 
C»\ph{ n .infi putiln^ C.fowlh is luftlief 
enh.nu<»d wiien Un'.iesnlts oi jsse-.snsenl .lu 
presented n^ ^^ruUofed it'tMjb.u k 
e\pt»f»enf n Jn< h ihe stoHent {.in »"\pe< t 
a CiUelui ,nmuM.!.ir\ on Ihm peMooniUu e 
Its i'lement^ .jnd Ms unphc atinns 



Holistic 

The third defining concept we recognized as, 
we develof^ied our assessnent process is the 
holistic nature ol the comfietences. We have 
,analy/'.*d them inttj levels and component * 
ahihties in order to make ihem manageable 
tor eftective teachmg, learning and ^ 
assessment. Yet we reali/e that the 
com|>etences are, in reality, msefiarable 
parts ot the w^hole person. Taken together, 
they answer the tirst (question we asked 
ourselves about outcomes; "What kind ot 
jH'fson, with what c harac ter^stu s. are we 
seekmg to develop^'' 

The sftjuential levels ot the conipetences 
are therefore cumutalive , hi both experience 
and assessment faih level buiUis upon and 
iniliicies tiie jjoor levels, and the student has 
irec|uent ofjpoftunitv t ) further evaluate and 
fettne .)i)ihtt(s for wh»Ji slie has alrea<iv 
in^en \ahch)te<{, InP^'ed, we (f)nsiantlv 
tonrfiinaU* our mstrut tio'nal tMforts to efisure- 
tlial tilts autnni.ilK <illv (Kcurs *\s siie 
ufuk'hakes to sjiei ilv uureasingly complex 
relatuMiships .mn)fig worhj events 
i( ofiEempor.uv vvorU). leve^ ^, ior <'\ample. 
^he must iiegtP interwcMMfig the sen. i. ate 
historic jl hackguHitiHs ihev cKose frtmi a 
sophi.lii ^\\^}n .>f lu*f [no\en .jbihtv to 
explore a single evefil's hisUuu.il context 
,i<Hel J' i'nof It'vels ol .ihtl 1% .ire thus jiul 
onK feiiiioHed, hoi jfo draw n .1 nto more 
A\u] fuofo ( ofnplev uses 
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At the same time, learning and assessment 
look forward beyond the level at ha*id. In 
each course or individual learning 
experience, add in each assessment 
situation, we attempt to elicit from the 
student the most advanced jierformance ot 
which she is c apable, f or example, while 
keeping a jourmi to find and make explicit 
what her valuta are (level 1 ot valuing), a 
sjudent IS lil^ely to explore her ac tions, her 
aesthetic preter^^mes or her rehgioijs 
heritage/She miglit recurd reflections on 
various products ol our !t*chnoiogical age, 
from modern mfedic ine lo transistor radios. 

Her mstrucfcjr wcmld examine the journal 
^according to tlie criU^rid tar li'vel 1. In 
addition, the jnsuuctor wouki pomt out 
where the student discerns expressed values 
in artistic and cultuftil works (level J) or 
mter* value f)rublems imphut in technology 
(level \). The teec*i)atk would thus sIjow tier 
where she is already developing abilities 
beyond those Jor vvhitti she js swkuig 
validation. The untimited possibilities tor 
exhibiting lonipelence are even mi^rv 




evident at the advanced levels. Here the 
student helps design or select highly -^'^ 
complex assessment situations, often in '| 
, professional or other field settings, which 
challenge her abilities to their fullest. 

The criteria by which the student's 
performance is judged are necessarily 
sj>ecifit to the level for which she is seeking 
validation. But with precise observation as a 
basis, the assessor can move in feedback 
l)t^yund the level at hand to d*scuss the 
broader implications of the s udent's 
l>ertorma'nce, Iri' recording e^act information 
aboul the student's |.>erlormance, assessors 
may Ih» called on to judge whether a given * 
s'lemeni is present or abs€»nt, to quantify its 
irequency or to use a rating scale. Always, 
they are rxiKHted to note illustrative 
examples, in both qualitative and 
cjuantitative measurt^, however, we take 
care not to place a <,eiling on the degrw to 
vvlitrh a student may excel m demonstrating 
" thv criteria involved. Indeeti our constant 
efnf)hasjs in leacf)ing and assessing is to 
en< ourage tfie student to go as tar as she 
tiUi with f)er rieveiof^ing abilities at every 
r)|)portiinity. 

f fnaliv, the iomjipfeni es aiid their 
asst»ssnn'nt are by nature inte x rdted . This^ 
too. Is inost'*'apptWept at the advanced levels, 
tarlv asse'^smeHls are fairly well enclosed in 
IhiMr design, m order \u Uu us the studerit's 
. attention (l)olh a*s a |)i»rtormer and as an 
tissessorj on a partu ular elen-ent ot a single 
jbiitlv. Bv tin* time sUv is vvoiking toward 
iuKtinct'd lfvt*l validations, lunvever. We are* 
looking fxpluitly «it yvera! t <)ni|H'!"nces 
n|H'i.itHV4 ( ofu eft. 
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When a nuriiing student is ready to attempt 
level 5 in problem *»oiving, she incites an 
instructor into her field setting (or a clinical 
co-assessment. She may choose to seek 
validation for social interaction and valuing 
at the same time. Her written "nursing care 
plan" for each client records her command 
of problem solving as applied to nursing. As 
she deals vyith her clients face to face, she 
carries ooi her prubiem solving in action 
atld also displays her interactive abilities. In 
diagnosing a client's needs, assigning them 
priorities, and evaluatmg her plan and its 
''eftcx:tivene>. she ,)lso applies her abilities in 
valumg. From the student's nursing care 
plans, the co-assessor's careful record of her 
clinic*?! performance and the student's own 
critique of her work, she can In? assessed m 
all three comf^etent es: s(k lal mteraction, 
valuing and problem soKmg. 

In like manner, an English student set^king 
validation at levels 5 and 6 would be gisen 
a week-long simulation exercise. At this 
level she must })e able to analyze, respond 
to and e\aluatr complex literature that 
ref>resen|s a \anetv ot writers and histciftcal 
jjenods. She miist also be able to extend t<j 
human expener • e in ge*neral ihe 
understaruitng oi {nulHf)hcitv ot pom! ol 
^ view tPiat she has de\elo|JiHi m the i ontext 
cjl literature. 

Working two to three hours a day w.th 
.several peers js the stall ot a ttctitious 
community c ultural. center, she handles a 
variety ol problems. WMv planning .in 
uiKommg literary teslisal, shv might \)v 
askecl to' step m as emergency sulisiittile 
tea her'in an adult c lass (m f l(/cil>ethan 
playv She may \u\\v to rieal j)ersonailv ion 
videotape! and in writing W>lli a luMiehutor s 
refKMted attempts to miluend' tlu^ fuu-trv 



selections for the festival. On short notice, 
she may be sent to appear on a radiS talk 
show (also videotaped) to respond to 
citizens of varied perspectives who calf in to 
criticize ciiy pians for razing a block of 
tenements in order to expand the center. 

In a variety of ways, she is called on to 
apf>ly her literary knowi^ge, her ability to 
define and defend criteria for judging works, 
and her understanding of the impact of 
htera y a1 on its audience (aestf^tic 
response). At the same time, s^'^e must frame 
and deliver complex messages to varying- 
audiences usmg several media 
Uc^mmunicatK ns). And she must ref>eatedlV 
draw together a variety of works in terms of 
their commonalities and contrasts (analysis). 
The written, sound taf>ed and videotaped 
rec «rds of her week's work thus jirovide an 
ample basis tor assessing stucJent's 
abilities in three dilterent com|>etence areas. 

Beyond enhancing the immediate value of 
our assessment techniques, our insistence on 
a holistic tocus has helfHHi to remind us of 
the surprising vaiuMy ot ways m which a 

given ability can l>e demonstrated. Our 

stuiients' myriad \anations upc^n the theme 
sot by a g{\e insiriimen* continually broaden 
our awareness ol what to look tor, as well as 
proMciing cone rete exident v ot their own 
un((^iH\ <ie\ eloping styles. We are thus 
enabled, as assessors, to apf)reciate a wide 
range* ot possilik* delinitions tor "successful 
performance." We also learn more' about 
bow to (lesign our asst»ssment experiences, 
fine tuning fiiem tor specituity and 0{H»nmg 
th(*m to elicit tlie richest possfl)le response. 
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HowN^ Design md Do Assessment 



: When we began designing our first 
assesjwent techniques five years ago, we did 
not rely on a proven jnethod ov manual — 
there was none to be had. Nor did we start 
by trying to write one. We began with 
individual faculty members and departments 

, struggling !o take abilities that were implicit 
as outcorros of their courses and turn them 
into something concrete and observable that 
students could be expected to do. 

By now we have. designed, used and 
nK>dified or discarded literally hundreds of 
separate assessment techniques. In the' 
process, we have exploreiJ countless , V 
approaches to the fnoblem of how to de*tign 
an assessment. Finding. a smgle authorised 
method was not our goal; we have found 
instead a principle and a |>attern that seem to 
underlie all our successtijl approaches. 



The jKfncipfe is simple: to begin by beirig 
c/ear as possible aiH)ut the outcomes. We 
could not begin to w>rk out ihe impik:a^k>ns 
of our outcon^<entefed view of education 
L .1 we became specific and c^aiied about 
whfch outcomes we had in mind and how 
they could be understood developn^ntaily 
Lii<ewise, we have found that we" 
cannot begin to'treate an'effective 
assessment situation until we are clear about 
which tipecihc abilities we are looking to see 
demonstrated ani|^how tt^ might «ppe£r. 
And we cannot hope to settle the d^ails of 
our design, nor to observe ard judge the 
student's iierformance, until we settle the 
question of w/?fc/i criteria we will use and 
how we will apply them. At each succeeding 
le^ el of sjiecif'cicy, then, from the overall 
curriculum lo assessing a single student 
|)ertormame, we start by sleeking the clearest 
fK3ssible view ot ihe outcomes. 



S 



The pattern h also simple. It flows from the 
fact that we begin with outcomes* While it 
resembles a sequence of steps (as in the 
diagram bebw) it is not a definitive formula 
nor a fixed procedure. We use if as a * 
**teuristic/' a model to slimuia.e and extend 
creative thinking. We have found this 
heuristic valuable not as a sure-fire necif^ df 



checklist, iHit as ^ way to raise challiwging 

questions. Whatever icteas or profatens we ,^ 
may have in n.lnd as we begin deigning .4 

particular assessn^nt techni<^ue, we can dien , | 

use this model to help draw out tlwr ^ 

implications and bring the varicKis elements | 

of the assessment into sharper 'focus.. * '% 
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A heuristiL h an altermUw ia trial and vrror. 
H is ^mplY the CiKiifkation of a uivful 
tiechnique or cognitive skill . It c art opcnatv as 
a discovery pnH tKiure ur a way vf gvtting to 
a goal. Many fields have fht^m, for example. 
^ scientific rretb^ d is itself a hcurisiic, as ih 
jovrnaiisn)VvffiLifnt Whof Whatf Whvnf 
Wheref Why^ furmula hn coILh frnn 
information. The imp<niant thin^ ahiWt 
nevristks ib thai thvy are not ''utvs. whii h 
dictate a rf^t or wrong way but an* 
Alternative nuHhtKls lor'ddftn^ sfunvthing - 
method*^ whii h 1)tton fofmali/i* the vfftiivnt 



procedure a good jc/e'init or journalkt 
would u>e unconscicHJsly, Because they mate 
an intuitive method explicit, hewisticr- open 
iomplen proteases up to the possibiliCy of 
rational choice. 



lahn R. Hayvv 
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the Hewfetfc with 0 

An instructor frfanning an introductory 
literature cour^, for example, mighi well 
choose.to offer analysis ^ a competence in 
jyvhich her students may seek validation, in 
ttw poetry section, st^ kvm^ she can expect 
the classk: problem that arises when one or 
two overzealous students rush off to hunt for 
**hidden meanings" while others who ^'just 
• can't see all that in a poem" conclude that 
they had better forget about poetry altogether, 
To d^a! with this prollem, she might wish to 
get the class into the habit of loc^cing 
carefully at a poem before asking anything at 
all abouk its meaning.' 



J ^1 
Such a goal fits in weH witM*ie faculty's 

general <tefinitton of the first fevef d analysis, | 

'to observe " This wtHikJ be an a$^>r(H:m^ ^ 

level to c/fter, then; and tNs inslmctor now *| 

has an as^sment to design. 4 

Her work would begin with the outcomes, ^ 
trying to break out the various elements of 
'sucr^sful observing. What does it mean to 
ob^rve? What does a person who is 
Qb^ierving a poem well-dof On her own, or 
brainstorming with colleagues, the instructor 
might welt arrive at a list something like this: 
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Qncs this open generatfhg of ideas seems 
fairiy well comptete, fhe.probfem becofws 
6oe of sorting and orda-ing. Some of these 
<uppp!jed elementsr; for example, are really 
synonyms. **Perceiw" and "attend to" restate 
the whoie concc^ rather than bfeaking it 
down into, more usable f^rts. These can be ' 
set aside (though not discarded — they may 
be quite helpful lat^r). * - 

Other items on the list are really conditions • 
for the fjerfofmance ototeer^ing, "Be alert/' 
ioT m^ance, is a precondition of any good 
cAservation, and may dimply have to be 
inferred from the more directly visible parts 
of the peiformance' **Find relationship*! 
faetweer} the chdracf-r«»" includes an 



assumption about.t^ design erf t)^ 
assessn%!nt sihiatidn, as cbes "^distinguii^ 
important- parts in the r//w ava//afa/e." The 
fifM assumes that a narrative or dramatic 
poem will be used, while the secprKJ dra'vs 
aitention to the.faof that sdr^ sort of time 
limit wilkneedlo be set* * . 

Other implied conditions can* be seen-in 
''destfibe the major features that rtlake the 
work .what it is" and "'report what's obvious, 
what's overt/' both of which poin't toWard 
the need to make the s4ulent's observing 
visible to the assessor. These and the other 
conditions can be separated out and nc^ed 
'Ipr later use in constructing the details of the 
assessment situatioii. 



COMPONCMT5 



INSTRUMENT 



• set- tjlutt hB%L. M4. 
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Tte items lhat remain, then, begin to look 
much more {ike actual OBQRaiKQte oi the 
ability to ofasene. Some of if^ ideas ipay still 
rwed^to be broken op^, ^Tifxi what's 

, obvious, what's overi/' « xampie, clearly ' 
sug^ts that some of what the student might 
be inclined to report k not obvious or overt 
— that it is something she has inferred. The 

• instructor might therefore restate thih as' 
^^distinguish what's obvious, overt, from 
wfiat's'implied,- covert/' 

In setting priorities among these several 
components, the'in?itructor begins moving 
in^o the design of the ii^strument a ell. 
'*See what you are supposed to*be looking 
for/' for instance, points toward the 
inevitable need for some kind of fram*^work 
in observing. Aire we looking at a pt^m as a- 
stream of words to l)e counted and sorted 
grammafically? A black-and-wbite graphic 
rr:.iposition? A typogr^nhic workf A serie^ot 
Jmagt*s? At some point, f-^student must 
come to realise thai framV^grks are .always 



invol^red in observation and to recc^ze 
which frameworks she is employing. A* Ihis^ 
Jevel, however, the instructi^ may decide noC 
\Q make that realization a specific gopl of 
instruction. In designing the assessnvent 
situation, tt^n, she can control <^ pre-sef this 
variafctie by providing tf^ framework in her 
instructions to the student. 

The instruaor m^y likew^^e decide that ''find 
relationships" represents too complicated a 
process 'at this point. Her concern, after all, i% 
to help students devefop the habit of doing 
the.simplefct kind of -observing .first. (Since 
relationships will be the explicit focus of the 
student's learning expeiiences at level 3 of 
analysis, th^ instructor ^n set thi- ability 
aside knowing it will receive ample 
aftenlion.i She will also probably decide 
jgamst a dramatic poe^^, since the 
ifileractiuns t>etween the characters almost 
force the reader to t(Kus on relationships. 
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**See»^tiar> there" arrd •'dislingiush what's 
obvkHis, ovtMt, from what's implied, coveft" 
Wflf be high on Her priority its! in thi«» 
as5esin>ent. In facf, slw may decide t« help 
focus attention on the difference betwi^n 

*-**wKat's there**, and what«ti}e stydent infen? by 
asking her to dray^ 'a^ortclusK^n and to cite 
the overt information thaf suggested it. fhe * 
instructor will therefbre be obli^. in setting 
up the problem* or "stimulus" tQ which the. 
student will be^asked.to/espond, to uiie a 

"poem in which the author both plainly sfat^ 
some thinp,s and deliberately implies others. ' 



Let us assume tiiat the ifbtructor has planned 

^ inclucfe several 470ems by Robert ffo^. 

From these she might set askie "In Ha^dwoo^^ 

Croyes/' a cfear insl^nce of dvert ami 

implied, statement, for use in t^^ assedSment 
} - . * 

Her instruiTient design,. tf^, could consist of 
a single class, hour in which each student is 
given a copy of tne poem and a set of 
instructions fgr a two-part exercise. The first 
l>art might ask the student to «s^nd^ 30 
minutes reading the jx^m and Wntirig an 
.exact account of the things arwl events 




stiff oslUL-h U 
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described. It might alfio her to describe 
the Hicaker's attitude, ami give ex idence of • 
how ^ihe determiaed »t. frora this wnnen 
''account, the infaructor tould then assess eac^ 
student's ability to obsiwe the explicit 
Mements in the poem, and to distinguish 
what Frost states from what he implies. 

To extend the learnmg potentiai in this 
assessment, the second fxirt might invoke the 
Mudenl for the re^ of the s**ssiori in^a small 
gruup, toniparinj; notes to find'thc basis for 
each of her dej»criptions*and for her 
conclusion atxjiit Ihe sfjeaker's attitude, and 
rating ihem as direct obserxation or 
inference- As nhe wojks through her note^- 
with her classmates, *she wUt probably rtc^ice 
elements she has not identified whf< h 
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lomeone else has, or vice versa.'Apfffving the' 
**overt/coveft" di^inction to h^ 'own 
ansNveff, she can begin to see where she 
was mmg direct observation and where she 
was using inference. Her^c^ from this 
discussion would fKovide th^ instructor with 
a written record of ihe student's abiHty to " 
^assess her nwn observing. 

' ^' 

The instructor would thus f 3vj/ pre set Ihe 
time frames and the f/amework for 
c^jservation (things, events, attitude), as well 
as the mode of reporting or making the 
•^observing" visible (written sentencesl. This 
assessinent design ako engages the student in 
some self-assessment, with the hdp of a 
group of peers. 



By^whaf •criteria will the imtrudcwr judge 
whetlw^ and how effectively the student has 
obsefved? This qi^iQnl%x:^s imposing in \^ 
the ab^ract. but becon^ ntar^able now 
that a concrete asse«isi^«5^*$ituati&n has been 
defined. How, the instructor can ask, would ' 
each of ;he cotnponents I am focusing on be 
expected to surface, in the wrii^ record? 

If the student is indeed able tf '*see whafs 
tiKre/' tf>e nrost important component for 
this assessment, the elements she identifies 
. will include nrrost or all of those that are 




vwffaWe ffomlh^ text of the pom. Because 
both the poem and the instrument have led 
im to make inferences, %\\e will surely have 
identified some elements by inference rather 
than by direct observation. Her ability to 
•'distinguish what's obsious, overt, from 
what's implied, covert" wiii be reflected in 
how well she isolates the directly observable 
elements by identifying those JIhat sht 
inferred, in her annotations -di»'' ng the group 
work. Finally, her ability to '^identify the 
major features that make the work what it 
is/' to ^^distinguish the im^xirtdnt parts/' can 
be judged by checking to see that her 
description includes the major elements, 
however many others she may also have 
identified. 4^ * 

t^avmg administered the assessment, the 
instructor wcxuld. record her iudu mehts 
according to the'cnlcria and arrange lor some 
u.rm of tiH?dhji k to the student written 
remark, |>erhapN accompanitxl l)v an m-i lass 
review of the assessment ''tor the vvhoie ^roup 
or by indfvtdua! c^^nferences. defKniding on 
how much of the course^ stie wants to deu)te 
to this particular learning ^x|H«nence. 
Evaluation and n^fesign would m r ur hi a 
number of ways. The insfruclor herseil would 
weigh h^)w welt tlie jnstrun^ent elif iteti 
^*i)b>«^mg lx»havtor" ancJ t hattengi»<l 
students to develop \hv\r awareness 
abilities as observers, w^th an eye to 
designing further assessments or preparmg the 
'course anew. Sharing her assessment design 
w*th her (,olleagues, lioth informally and 
' through the Analysts (*(jm|xMt>n< e Division, 
•she would also nneive their < omments.and 
make her design availaiyle as a nKK^el tor 
others. 



This is how the heuristic tnoA^l the • • 
assessment design process works to help an 
instructor move ^rom the outomm throu^^ 
the rest of the design. As any educator 
knows, however, good teachers frave often 
been able to ''hit upon" effective ways of 
encouraging stuq^ents to show what they can 
do with What they have learned. This is 
where the model's real usefulness comes in. 
it is nol a fixed sequence, from A to S to C; it 
is moR» of an open flow chart that can be 
entered at any |x^int. Beginning with 
whatever s/he has most cleariy in mind — a 
gtxxl stimulus, some criteria, a particular 
ability for students to demonstrate or just an 
unresolved question — an instructor can use , 
the mrxlel to help think through and design 
the other elements oi the assessment. 
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the Keltic VHdih an Exhl^^fed^^ 

Beginning in media res jike this, a n^ber of 
Our art department recently op^ted up son>e 
Cicciting Insights into the teachir^leaminjs 
values talent in the traditional practice of 
critiquing student work in studio cmirses. For 
a cfass in beginning design, she had readily 
olfered sfudents the opportunity to 
demonstrate competence ir the early levels 
of problem solving, since such courses 
commonly proceed by givj^ng students a ^ 
series of increasingly complex design -i^.t' 
problems to, solve. As she begarUarwqrk with' 
her opening assignment, however, she sensed 
^n apparent conflict. 



The problem she planned to set tl^ ctast — - 
to create variety, using a single shape 
(triangles) in a single medium (construction 
paper) — was a classic exercise In the^ 
discipline. But was she pre-anp^ing the ^ 
student's opportunity to discern and 
formulate j3roblems by 9^ing the pr<^lem in 
such specific lervn% and leaving'the miderrts 
only to solvg it? Hoping to work this ihrmigh, 
she and s colleague went through the 
heuristic model together to analyze vyhat was 
really involved in this beginning design. » 



The instrument was already clear. 
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The art instructor had also been working'on a 
fisfcoif sleps to guide the in-ciass critiques, 
which would be done first by other students 
and then by her. So the for this 

assessment might be drawn from thai guide 
list. Indeed, it turned oOt that her attempts to 
sketch out what was involved in good 
critiquing were almost a model **assessor's 



guide." Setting aside the first and te$^cp» . ^» 
(which are important tools in assessing, b^A^^ 
are tmA specific criteria) each item poit^ to 
a parlicular-dinwnsion d tJw sluctent's 
performaftie in c^cretely observable lenris. 
Though judgiinent was of\m\ called for, it 
always had to^ backed by pointing to 
particular elements and details in the 
student's work. 




S ^^^^ ' 





So far, so good. She then took the salient 
abititres for both levels 1 and 2 and broke 
them tnil tnfo Xiom i ionent^ , to see wh^her 
either list oi components would *'fit" — that 
is, whether they would be^ abstract statements 
of what her "criteria were measuring in more 
specific terms. After some brainstorming *snd 
editing, she concluded that *1ormulate a 
problem" could be broken down into three 
major comjTonents. These were to state what 



the problem is, to conceive of a solution in 
terms of an organizing ima^ or concept, and 
to state the problem and the' solution in tc^rms 
of i\w medium.«She and her colleague agreed ' 
that the earlier ability, *'find a problem/' • 
might be a matter of becoming aware of 
these three dimensions prior to being able to 
formulate them clearly and completely.. 
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Here, however, wa*i the rub. The contiict she 
had sensed at the qutiiet now lay before her 
in detail: It fieemrd that she was doing the 
bulk of the students' work for Ihem by slating 
both the problem and the medium, and was* 
leaving tliem o»ty the second com|X)nent:— 
conceiving a solution, an organizing image or 
idea — to work on. Morwver, it appeared 
from the criteria thai the student was going to 
be held accountable not simply for 
conceiving the urgam/ing image but for 
executing it successfully. This was .1 more 
, advanced level than she had planm*d to offer 
in this course at all - ^nuch lc*ss in her. 
Oldening exercise! But even as her colleague 
summan/ed this ratlic r bleak picture, the art 
instructor broke through the dilemma. "That's 
not true/! slu» insisttHl. "I 8on't care at all 
whether they acfually solve the fHohU^nv" 

Then why was tiiat among the criteria^ To get 
the student to <irtKulJtv her governing 
concef)! or organi/mg im**ge, to get her to 
look ai the limitations of her huHiium and tier 
own craftsmanship. Un many stucients, the* 
art instructor pomttxJ oul, tins is a new way 
of working. Tiiey tend to design an idt-at 
soiupon, unresirainefl f)y the actual 
limitations of \hv material and lCK)is InMore 
them. Many also are no! even aware ui 
having an image in concej)! in mind as they 
work, flaving to explain to a letlow s!u(iefit 
what they were *'cinving at/' what vision or 
fe4?lmg was guiding them, reveals lo some 
that they in fact had none, and explains to 
fhem why their wf)rk has no f oherence or 
sustained impact. For others, it begins 
introducing them to a sense* ot thrir own 
style, their aesthetic tiwiencies. Do they 
resfK)nd by drawing nut or imposing tmivt, or 
do they wofk.tt)ward more ciynamtc states ot 



imbalance? This, she explained, is really the 
only reason for demanding that the student 
articulate so much about iter intent. \l is 
hardly an essential ability (or a practicing 
artist, but it does help the beginning aflls! 
develop her <ense of her own vision. 

Working these insigKts back into the model, 
it became clear at once that the peer - 
assc^isment was actually part of the 
instrument . What was being sought in this 
a-^^essment situation was net jhe student's 
solution lo'the problem set by her instructor, 
but her res|)onses to the critique of her work 
by her fellow students. In what she could say 
and si^ about whether or not she hrul 
worked within the miKlium, ateut her 
craftsmanship in using her tools, about her 
govt'rning in, age and ht^r aesthetic 
tendemies, lay all the "outcomes" the 
instructor was in)ping to foster with this 
assignment. 
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The instructor was now able to return to her 
list of i ^^ppnent abiliti^^ and clarify it. She 
broadened the third compom»nt to include 
thi^ kinds of limitation — that nwifum 
Itself, the stiident's current level of 
craftsmanship, and her developing aestt^fc 
preferences — as well as suggesting that the 
siutlent learn to see these not only as limits 
but also as resources. 
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She then began to work on specifyir^ the 
critena she Mrould use in asse^'ng how wdi 
it^ student's responses to critiquing vmiid 
indicate a growing ability to perceive and 
articul^ the» is^tm, * ~ - — 

This art instructor was thus able to use tire 
heuristic model to revive her sense of 
conflict about her assignment Mwe than 
that, it enabled her to pr<^ the hiany values , 

had inhjttively felt were possible in using 
the exercise for her class, it al^ offered the 
wl^te faculty a nrddei fcK peer assessrr^nt^ or 
critiquing, as a way to stimulate a student to 
think more deejJiy-and to beccnne* articulate 
about her creative process and her esthetic 
sense. 
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EMAislIng Astssnnirtf MvdqLMS 

^ The Instiucto^'s work with ttie mcdd also ^ 
raised a que^w that welt have be«i 
passed along to ht)blem Solving ' 
Competence Division, Is th&fir^ levd — 
' **find a problem" — a preliminary 
"awareness" phase erf rtte abilitlH she and 
her colleague id«iiified at tfie second level? 
Or is^it a separate ability to diagnose thp 
tensions in a situation that betray the* 
presence of an unformulated problem? T^is 
kind of que^ion, which faculty members 
frequently encounter as they work with 
assessment in their courses, is one erf the 
major kirvis of infoimation (along with their 
actual assessment designs) that instructors are 
constantly feeding back to the respective 
Competence Divisions. In those divisions, 
reviewing all these instruments and the 
questions they rai?^, the faculty carries out its 
corfiorate work of evaluating and redesigning 
astiessment. 

The faculty members in the Communicatiuns 
Competence Division, for example, consider 
a variety of assessment modes in their 
semesterly reviews. For level 1 {"assesses her 
own strefigths and weaknesses as a 
communicator"), the student performs 
writing, speaking, reading, listening and 
grafrfiing at the Assessment Center. The - 
**awarei]ess" focus of this level dcx?s no! 
demand prior instruction in communications 
{rtiough the .student does receive instruction 
in self-assessment), and the battery of 
Instruments prm^ides a useful early diagnostic 
profile of communications skills and nmis. 
This assessment is therefore administercni 
tiefore classes even begin. 



In its review of this wMly artemal, §eowk vj,| 
assesment the Conwiur^ca^wi Dhrtfion ;^|g^ 
cotlects overall data on stoidert petktinxKm-^M 
and correlates that with data on the $ak»ditt "', -j 
who took the assessmenu Are any - 
instruments or parts o* Instrument causing p 
frequent dHficulty? Are there any patt^srre of -f^ 
difference between the responses of 18 year 
old stutients and returning older women? 
These are the kinds of questions di ifislOT 
members try to probe, with tfw help of tfie 
Assessment Center ^nd the Office c& j ' ■ 
Evaluation's statistical resources. ' - : 

• f 

V. 

Division memb^ also check with faculty 
who offer Iowct l^els of communications in 
their courses, to see whe^ students an? 
being plattd well and their needs are, being 
diagnosed accurately by what these - 
assessments identify, this in turn helps these 
instructors to refine and revise their own 
course designs, as they g^ a clearer picture 
of the range and patterns of student abilities 
and needs. 
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A diffefc~t use of the generic approach 
aqapears at level 4 ("effectiveiy communicates 
complex content from a vari^ of 
disciplines''). Here, the stud^t must receive 
one of her three required validations on a 
coiie^wide instrument, wtiile the cHher twj 
come from assessrronts that are completely 
designed in individual courses. Drawing the 
stimulus from one of the student's currerit 
courses, the generic assessment for level 4 
l^pne in the Assessn^l Center) gives her the«- 
opportunity to use multiple media to support 
her presentation. 

For level 3 r'perform*^. effectively as a 
communicator''}, the^ division also has 
developed a generic inslrurr^nt. Tor writing 
arnJ speaking, i wever, that means qnly that 
they are agreeing on a set of criteria . Each 
instructor is urged to add further criteria 
relevant to the particular course and mu^t 
design the actual stimulus as well. The 
instructor then briefs a member of the 
Communicdtforis faculty on tfie modified 




instrtinient and they work as co-assessors of 
the ^iMient's wrilir^ or sf^king. Because tht 
instruments vary, overall studies ol 
performafKe data are harder to create than 
for level 1, Instead, the mtMe cwimon 
redesign process is u^ ~ dialog bel%veen 
the members' of the Competence DtvisicHiA 
aiid the^acutty who offer this level, t 

So far^ the ger^ic criteria for level 3 are stitt 
in embryonic form. A single major criterion is 
applied in addition to those beg^n at levels I 
ami 2: 'Treats the topic in a manner that 
involves analysis and/or synthesis, so th^ it is 
more than summary or observation," After a ' 
year's work as co-as*jessors in several course 
settings, the Communications Division 
members will meet with the instructors 
offering levels 2 and 3. They will review their 
exf>erience and sift the particular criteria 
added for the respective courses, and arrive 
at refined criteria for both levels. 

The Communications Drvisioh thus uses 
instruments that are generic in a vari^y of 
senses. They inoved more rapidly than other 
competence divisions toward this generic 
approach, as the faculty discovered that the^i 
wanted strong guidance and assistance in ^ 
tearh!rf>^ and assessing communications skills. 
Reading a^d writing, speaking and listening 
had gradually fallen to English and Speech 
department:, as spec^^?^izfx^ «»ubjects in 
colleges and universities across tftc nation, 
and had become unfamiliar to the average 
biology or music theory instructor. By iht: 
same token, however, English and Speech 
instructors who had spent several years 
wrestling with these abilities and how to , 
fptich them were willing to take on the role 
of "experts" In order to get the creative 
diiilog started. 



Ko similar process of altrition had removed 
analysis, or critical thinking, from its many 
natural environments. The faculty members 
who volunteered -fi^the Analysis 
CofiipeiefKe Division thus found thwrsefves^ 
with quite a different task and appro^^hed it 
quiteadifferently. Initially, they offered a 
tentative outline of six sequential levels far/ 
the developptent and demonstrafion of 
analytic thinking. After some discouraging 
attempts to develop generic criteria and 
assessment situations, they realized that the • 
^ "expertise" was diffused throughout the ' 
faculty. No one group (thtmiselves included) 
had spent the years of focused effort on 
analytic thinking that English and Speech 
instructors had |K)uaHj inip Fresliman 
Composition and Introductory Spwch. 

The Analysis Competence Divtsion mernliers 
therefore turried their efforts toward 
encouraging each instructor to siuUf.ien 
h^r/his ex^jertise. They asked each coUeague 
to work out an explicit model of the kind of 
analytic thought employed m her/hi> 




' discifrfine, aixi to ck^vetop specific aisesimtnl w 
techak|i«s and criteria to measure a studertff 
pr^^s in devefof^ng h. 

M emb e rs of -the^ div isi on c olta h r H-a te ri 

individually with 25 colle^ues, representing 
each erf the college's ac^ieo^c and 
professiOTal ctepartme|>ts/ to capture the 
current slate of tte art in the respective fields. 
They then took a Friday afternoon faculty/staff 
workshop to report on their finding, and 
asked two instructor'^ to share their work on 
how analysis occuni and can be uught ^tni 
assessed in philosophy and in accounting. 

Only as these disciplinary embodinwnts of 
analy^iis become clearer will the Analysis 
Competence Division begin seeking the 
generit, college-wide patterns that underlie 
them. In the rneanwhile, they use their 
semesterly review Junction to serve as a 
ckwinghouse, linking instructors who are ^ 
making similar discoveries or ta€ kling similar 
problems. They also work to broaden the 
whole facullyS awareness of the many ways 
m which analytic thought actually takes ^ 
sha|)e ,ind can be taught and assessed. 
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Adnninistefing Assessment Mviiques 

An aciudi ass^sm^^ instrument may, as the 
art instructor's did even when she was done, 
appear iittfe changed from what students 
had formerly been asked to do on a familiar 
"^nd provefrexefciser Ti may, as in ca^ 
of the poetry assessment, add new elements 
like the small-group review of the students' 
written responses. Or it may, like thje 
upper-fevel integrated assessments for 
nursing and literature students, involve days 
of effort on th^ student's part in ^ictivities of 
a complex and innovative character 
What distingjishes even the simplest, most 
* familiar assessment, however, is the 
presence of ^uch dimensions as the specifrc 
component labilities being sought and the 
criteria according to which the student's 
performance will be judged. Equally 
fmportani is the I act thai the student s 
learning ex|x»nehces have been planned to 
foster those vame abilities, und that she has 
known from the outset what methods and 
criteria would be used in the assessment 
and why. 



Whether it is simple and famtltar or complex 
and innovative, whether tt takes part of a 
classroom hour or most oi three days in a 
\ TV-radio studio or on a nursing home ward, 

t*adt assessn^ent^iso recHw^ ^ - 

participation of one or more trained 
assessqrs . It is the assessoi'who must 
carefully observe and make a record of the 
student's performance, noting behwtor that 
reflects the presence or absence of the 
particular criteria andifecording illustrative 
examples. It is the ass^sor who must-judge 
whether the <:riteria were adequately 
demonstrated to validate the student as 
capable. And it is the assessor who must 
either'^give the st JC^enf her individual 
leedback or ^^repare a detailed analysis fromc 
which others rtiay <4o so. 
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At 0}>e time or anoH>er m ^he students 
pfogms, she encounters assessor* drawn 
from every segment of the colte^ as wefHas 
from the wider community. Most oftert, her 
instructor assesses her performance, 

sometimes in conjunction with^ant^her 

memberof thrlacdty. M 4inM5. her 

classmates or advanced studtents in her area 

' of concentration may 4IS0 assess her work. 
She is also always being trained Jo assess 
herself, and from the very beginning of her 
career at Alverno she has n^ community 
members Who serve as voJuoteer assessors 
to provide outside perspectives on her 
performance. 

< 

The several Competence Divisions train 
faculty and staff members and advanced 
students who have volunteered to serve as 
eKternal assessors, as well as alumnae and 
other professionals from the community 

* outside the college. Both on and off campus, 
these assessors are recruited by the 
Assessment Center, which also fJrovides 

. logistical support for their training. New 
faculty receive assessor training (as well as 
training in designing assessments^ during 
their orientatton. In addition, field and 
clinical co-assessors are recruited and 
trained by the ft^>ectivp professional 

^ department?;, and on-site menlcirs tor 
off<ampus and un-campus exi^H^riential 
learning (CXiEL and ONCEL) pro|ec1> o' 
volunteer to l)e framed as co-assessors 
student's work. 



In each i^ase, assessor training involves a V 
^careful discustion of the phtloioj>hy and 
purpose of assessment, and of the criMria fo 
tte articular asses^twit fm which the 
assessor is U^ing trained. The training 
sessions also inciiKie ^ number of 
simulations, in which assessors-to-be 
- pf acike-aiKLrefine tteir observing and 

recording skills using sartlpte-studeia . 

performances and deyclop their ability to 
provide specific, soipportive feedback. 

Beginning assessors, once trained, are 
u^iually teamed with experienced assessow 
for their first '•live" experierKes. Assessors 
are also given '^brush-up' sessions at regular 
intervals, and may be required to.engage In 
such a session if their assessing work begins 
to fat! out of phase wittj that of their 
colleagues. In addition, wteneyer the" 
criteria or other elenfents of an assessment 
^ design are significantly altered, all assessors 
tra1f>ed for that assessment are updated with 
special training. 



IV How Students Experience Asse&menf 



For the sttSfentr^sses^imwt Is one of the 

most distinctive anfi powerfuti5aftM)l 

iearrting at Atverno.^ AssessnYent probably^ 
her most intense, continuing contact with 
the Alverno learning system, and it makes 
education at Alverno visibly different from 
aim^ any other college edocatron she 
might have chosen. Assessment also draws 

" her into an encounter with herself. Any 
testing situation is liiceiy to be a critically 
personal experience, a lime of maximum* 
vulnerability when a person presents herself 

-^anii what ^he knows for external 
examination. "Sot liec^ausejhe Alverno 
student's assessments focus on her" own 
developing abilities rather than on some 
external norm or objective ixxly of data — 
they have an even more intensely personal 
impact on how she sees herself. 

Working together as a faculty to evolve a 
coh€*rent, coltege-wjdt dssessment system, 
we have become increasingly able to shaf)e 
the student's four years of assessments mio a 
coordinated developmental experience. 
Within the overall system, students take a 
multiplicity of indfviduaJ paths and vary 
widely in their rates of growth. Vet there is a 
general pattC>rn of deveiopmeni, t>eginning 
with the incoming student's first 
overwhelming exficsure to assessment and 
culminating in the graduaie's/aciiity ut^ 
managing her own learning. 



We know thi! pattern has b^un when ^ 
* student start^ iOlCCIUiUbtt the learning 

"^ocess4^ reaUzing that if is not •^outside" her 
a*hd urKterrtailding whiit j^e is doing and,,, 
why. Her devetopment intchslfie»4ateL^ 
she begins inlCKtiiOS her sever^t 
competences into a unified profile of 
abilities^arid her approach to learning and 
gltilCCllkillg abilities she h.is developed^in 
ore contexl into otfier realms' of apjJlication. 
8y hpr final semesters, she operates as a 
self-directing learner, planning appropriate 

^ learning pxperienc^" and helping to design 
techniques for assessing her performance. 

The pr<Kess ^^ins early — well before the 
student's first day of classes. Imtoediately 
after sheJs admitted, she selects one of^ 
several New Student Assessment Days 
offered in the months before her first 
semester begins. The daylong experience, 
administered by the Assessment Center, 
l>cgins with a general session setting forth 
such concepts as com(>etence, assessment 
and validation. This session reinforces the 
exjKJsure to these ideas she has had througti 
admissions matpriais and advising sessions 
and possibly a campus visit. 
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most effective learning, hnweyer; coims 
from experience. The student spends most ot 
this tusy pre-entry Asseswwnt Day 
participating in half a dozen assessments at 
Ihe first level of communications. These 
have a dual purpose: 0) <o provide a 
diagnostic profile of her abilifies and needs 
in writing, reading, speaking, listening, 
graphing and reading graphs, and 12) la 
give her an c-xtensive introduction to 
self-assessment. Although her performance 
-s^l^ach of these six areas is carefully 
recoiled foii^eedback and for use in 
planning her leartHOg e^oeriences, her 
validation at this init,ai I« veV^i^nds solely 
upon*ef dbility lo a>ses * her own ^ . _ 
performances accurately, qo matter how 
successful (or unsuccessful) they are. 

For writing and speaking, the student ts 
asked to write a letter and to draft and 
deliver a ihrep-minute vtdeotaped speech, in 
"^ea^h of which she must take a fK)sition on 
an* issue closeio her experience U^gw open 
vs. selective college admisskmsl For 
graphing, she is given sever:.; items of 
mathematical information to organise into a 
single graph, which she then reviews and 
assesses, / 



TN? asi«wtm technkuKfti^fdf flftenii^ ^ 
reading and reading graphs am all quite 
similar in ctesign. In each, tte rtudeiU is 
exposed to an approjiwlate stimulus — a . 
videotaped speech, an article and a graph, 
respectively — and is given a series of 
open-encted qwrfions about it. She ihtn 
assesses .her answers, looking for her / • 
strengths and weaknesses. 

This beginning communications assessment 
carries over into her finrf week on campus. 
During ^ientation week, the student spends 
an hour reviewing the letter she wrote and 
makes an apt^intment to self-assess the 
videotafie of her speech. After she has Ijad 
instruction and practice in self-assessment, 
shV as^ijesses her sfjeech. She then receives 
complete feedback^gn her performances. 
She and an assessor also review her work as 
a sglf-assessor on all six instruments. . 

Students vary in thetr responses to this first 
encounter, but they all te^ify to its impact 
and complexity, **They had a get-together for 
all incoming treshmen/ one recalls, "to 
of4exit me and my family to the new 
vocabularv; ilier^w system, the whole new 
outlook. It still left mecoafused, but ii made 
me start looking. They talked aboiit 
^ssessment^i, they talkctd about levels and --^ 
validations and it was just like. I'm stepping 
' into a whole new world/" Qthers are less 
eager to begin exploring unknown worlds; 
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Wc sdt in the auditorium our f/>$l day here 
and the president was tefiing us, ^You're a \ ' 
\yoman/ Vou'fe very independent You're 
going to learn how to fearn in a differenl ^ 
way," And everyone > going, ''What are (hey . 
talking about It was realty threatening and 
challenging. It wa^ very, very threatening, lt\ 
wai like going into a different t ulture. 



Even with a prior visil to the Ciimpus, ope 
junior noted, **H was sUV realiy confustng. 
You have lo experience it to reatly 
under«^Mnd the value of if/' 



Experienc if,g ha\i a dozen assessments in 
one day does promote understandmg, but il 
fs a bracing way lo tearn. *'You came in tor 
on^ day in the s|Mn^ and were bomf>ard€*d 
with mimeographinJ sheets and tests/' an art 
student rtH alls, "Tliat basically scar^ me, 1^ ' 
didn't know it this is what college was rvaWy 
like, and I didn't know if I wanted to stick to r 
it. Bui it got txMter/' Nearly every new 
student would agrw with the nursing ^ 
student who tound her sf^aktng assessment 
the most memorable part ot the day: "1 
ne\er hnri to make a>|HH^ h in my lile 
Nand wo had to gne one in from of a s-ideo 
* iT!arl>^nl»^ Ihvvas the mn<r terrifying 
^x|K»fitfnce I h^d e^er liad m mv>vh()!e \\tv/' 



Counteracting such feelings of confusion 
and stage fright, however, are th^ " ^ 

opportunities for self-assessmeni and 
feedback » For most students the^e Of^n Op ' 
new oppt^riunities, riew wayvof looking at 
their own^ wwk backed by tangibtei 
evidence. ^You sit*there * nd watch t>ait ' 
^ of yotjr sjj^h" on videotape^ the 
once-terrified nursing^ student ^ys, **and you 
;hink *Oh my Cod, ! d|d this apd this and 
• * th'is wrong/ and you don't con^eptrate on 
S nvhat you did well. But they sness that more 
than they do'your weaknesses. 1 think that's 
feally imfHirtant, especially when you're just 
f>l»ginning/' A former high school debater 
^ foiind herself "very excited to see that you 
can break it down into ail these behaviors . 
and parts of the speech. which^J had never 
done bi»fore. 1 thought by ^evaluation' ihey 
wuIJ me *yotjr sf>eech was good.' or 
Your sf>eet was bad/ But they really made 
some cone et ? statements about it/' 



Getting Used lo Assessmeflt 

Atiiii 1 lasses begm.'the student's experience 
ol assessment liroadens raptdly. In her first 
semester she probably will at least choose 
to »Htempt validation at the first level in all 
se\ en remami ng < omj>eten( es. 



r 
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Three Of th^ assessments will cKcur in the^ 
As^iessmenl Center, in conHiriction with the 
requirld Freshman Seminar, For hen 
beginning assessment in social inta^a<-tion, 
, she joinii five other students in -a 
task-oriented group simulation. While a 
team oi six assessors observe and records 
each student's verbal and non-veribat 
tehavior, she and her five peers work to 
reach a consensus. Afterwards, she outlines 
the iO to 40 minute interaction as best she 
can from memory, and evaluates the group's 
^hieven>ent of i tsj^oa ls. She then assesses 
her strengths ant^^J^knesses, and those of • 
each of her peers, according to sp^ified 
cnteria. After the externa.1 assessors reach 
consensus, she meets for a one-to-one 
feedback session with a member of the 
aWssor team. ^ 

By contrast to this team ex|>enence, the 
student takes her first asses5»ment alone in 
the environment c ()m|>etente. King a 
" written guide and a videotafx\ she identiltes 
several types ot enM.ronmental systems 
matural iobgical, economic, aesthetic, 
elc.) vv4thin various settings and selects one 
. for a RKKe detaileni descriptive an ilysis. Hrr 
f written transcript is revleweci and annotated 
by a trained assessor, with whom «;he has 
the opportunity to meet lor mdividu4>l 
feetihac k. 



Tte student wmks wl^h two peers In her first 
contemporary wcw^ld asse»ment WUhln a 
pre-set global issiie, such as energy, she am< 
her two teammates select a more ^jecifk 
topic (solar energy, opening uff offsfiore US* 
reserves, etc ) aiid each takes a separate , ♦ 
**interest focus'' (oil cdmpajtie^, consumers, 
government and so on). After several weeks ^ 
of research the students apij^ar as a pajwl 
and are interviewed, by a tramed discussion ' 
leader, while a team' of three assessors- ' 
rrcords their remarks. Each student has- a 
supplemental V one-to-one followup sdssiqn 
with an assessor. The three assessors then 
reach coni^nsus about^ach student's 
awareness and irrvolvement in relation to 
the topic, its implications and its importance 
for her, her country and the world. She 
receives written feedback, with the 
opportunity for i personal session with the 
discussion leader. 

* 

for each of these three assessments, the 
stutient rec<»ives extenstve preparation \i the 
Freshman Seminar. Class sessions acquaint ^ 
her With the concept*, and terms involved ~" 
the task-oriented model, for instance, and 
the various kuids of lH»hav!or (initiatmg^ 
summarumg, chaliengingl that can lie 
fsolattni m a group discussion. She and her 
. iassftiates also receive repeated 
of>poftuniltes in class to learn them m 
practice. The student then decides when she 
IS ready to attempt validation, and makes an 
dpi2omtmen! with the Assessment Center 
statf. Should she not he validated, she may 
make a new appointment and le-take the 
assessment until she succcnnis in 
demonstrating the abilities involved. 
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For the first level of each of the remaining 
competences, sh? is assessed in her various 
courses. Because assessing in multiple 
sett'ngs is required, she may be taking as 
marry as a dozVn or more separate 
assessments in order to be fUl^ validated at 
. level one. Irr a beginning chemistry course, 
for example, she may be offered learning 
experiences and assessments for the first 
level of analysis and problem solving. In a 

' music history class, she might seek another 
validation for analysis {for which a total of 
three is required) and one for aesthetic 

. respOiis*^ r which three are needed). 

In lier coUtses, as in Freshman Seminar, 
numerous repeated learning experiences 
i . help the student develop her uf^derstanding 
and ability to the pomt where she is ready 
, to attempt validation. These learning 
experiences frequently mtorporate elements 
of assessment, such as specified criteria, 
feedback, and so on. Many instructors also 
use an assessment at the beginnmg ot a 
course, to estabhsh a kind of. baseline for 
students to use m judj^ing thci: own ■ 
progress. 



Once she has been validated at the first 
level in a given competence, the student 
may also work toward level two of that 
competence — in the same course, if it is 
offered there. Indeed, many beginning 
freshmen contract for a dozen or nto^ 
second-level validation attempts in various 
competences, A sttident may thus participate 
in more than two do2?en assessments for 
validatWn in her first semester*-*— not to 
mention 'the many diagnostic or formatf^e 
assessm^jits her instructors may give. Sht 
also \viH be called oR^to «sses*i her :\ 
instructor's |:^rformanc^U«.each course, 
part of-the regalar faculty evaluation \ 
process, \ 

As imfK)iiing as this sounds, she actually 
s^:re.ids no more of her time involved in 
ass^assment than her predecessors used to 
spend writing papers and reports, 
"cramming" and taking exams. Unlike 
traditional tests, hov^ever, each of the 
student's assessments contributes directly to 
her learning. Within each course, the 
assessment} are designed primarily as 
learning experiences, helpmg her to become 
aware of and to develop abilities 
fundamental to the disriplme. In addiffon 
the overall breadth and numl)er of her 
assessment expertences, both ir/ciass and 
the As»iessment Center, provide her verv 
early m her college experience with a | 
wide-spectrum view of her own nihilities 
and needs. 
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The lnterndiz^ Phase 

• As ^Vesu'lt, these first few months enable the 
.stutfent \o begin ielgmjiiiiag her iearning 
; experiences, She moves away from things 
^ that 'Ithey" expect her to do in order to "get 
'by," and toward the understanding that all 
|his k>happening to her and for her — that 
^he, nf}| the instructor or the materia! or the 
requireijnenfs, is at the center of the process. 

The ra{>id total immersion of her first few 
months actually accelerates the student's 
growth toward a |>ersonal understandmg of 
the Alverno learning process and herself 
a learner. She is so extensively involvetJ, in 
so many diverse areas and with so many 
! parts of her own selfnmage, that she 
assimilates tlie entire f)rocess and makcb'it 
her own much more readily than she would 
■ from a more restnc ted, gradual exfK)sure. 

When our assessment system was m its 
infancy and oltered fewer les> complex 
alternatives, studects reguIarK reporteti an 
''Aha!" experience -- sudcieniy 
comprehending what they were doing and 
why — tn the sc»c ond^-or third seiTiestcL As 
our system lias matured and tht^ range of 
options has fnulti[)lit^i at every level, most 
freshmefi *?re reporting that l)reaMhr()iigh in 
- the tirst montli or two. i 



"•At firs^ glance,'' one student r^alls, **it's 
frightening. You came in wondering exactly 
what in the world a competence level was 
and you never really understood it until 
halfway through the semester it dawned on 
you like tne sun coming up in the morning. 
It just hit you all of a sudden ~ *Oh, this is 
it!' dpd it seemed like something you 
should have reali^c*d a long time ago." As 
another student put it, "The competence 
system isn't something that can be taught, I 
noticed that m my freshm^in year, when I 
had to do a philosophy assessment. It's 
somethmg thai" can't t>|» taught but just 
hits you." 
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The breakthrough isn't always an 
unex)?^ted gift; many work hard to achieve 
it fe\v ^eeks into the semester,*' one 
sophomore says, realized I didn't know 
y^i^e f vvas going. It wasn't coming 
1eg0jher,'So 1} just sat myself down with aft 
the syllabi and the materials t)^ey hand out 
ai^rd i readi f jead for a whole.4ay|until it 
startie^ qiaking sense. I haven't \\j^ci any real 
problems since then.** Others ^tru^le 
longer; ;^ ^' / 

I jemembe/'a whole semester running 
around trying to find someone to explain it 
to me , . . bomehovy or aiher I guess I sort of 
. figured it out. It's d painful process in the 
beginning when you see those horrible 
words, but all of a sudden you get thi< 
practice and thv process is practice, it's the 
practice, I guess, that w fnile thing of 
rtewne.s.s, then practtcing it. and then it k 
becomes a part of you. 



I - * 

! 

\ i * ' 

As she contends with these demanding new 
, experiences, trying to pull them jpto some 
rtieaningful order, the student can buWd up a 
strong sense of frustration. Themnusual 
\ elements of her education — assessment in 
fi^rticular — offer ready targets. **When t 
first came here I was pretty unsure about the 
program/ one student reflects. **l guess I did 
go through a period of negativism wljere 
everything about it must be wrong." hated 
what they were telling me," one senior says 
bluntly. ""If you would have asked me as a 
freshmaf: what I thought of Aivemo and the 
assessment:;, I probably would have slugged 
you.'' 

Because*. ours *is a college-wide system — 
designed and evaluated by the whole faculty 
workmg cooperatively — we are much 
better able to tolerate and even to plan for 
such pressure points. Frustrations and 
pre<isures are^ afte»- A\, inevitably part of any 
task worth undertaking, and they are 
especially critical to personal growth, A 
student used to passive and abstract learning 
m^iy w€*ll feel unfairly put upon when she 
must take the initiative and actually engage 
in an active learning experience or perforrn 
in an assessmentr instead of simply reading 
a text or playing back lecture notes. 
Similarly, tating up fo her f>erformances and 
what tfiev *»ay about her abilities and 
weaknesses is likely to he difficult, 
threatening work for a student whose prior 
schoohng has led her nc*t to be reflective at 
all , in rote learning) or to be irrespcjnsibly 
subjec tfve. 
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fn a tratittional setting, no single teacher or 
department couid get away with demanding 
so much, when others offer easier 
alterfi'atfves. -But our joint effort to create a 
unified atmosphere, in which the sfjdent 
— *bumps into what sh? needs no n»atter 
where she turns/ allows us to greet signs of 
aVpropfiate frustration as indications that the 
growth process is moving along well. As one 
department coordinator put it, **f know 
we're on the right track when the freshmen 
come to me and complain, *Whv is that 
instructor getting paid? Vm doing all the 
work!':- 



myst 
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Along with-btrTTt-in frustration, of course, 
come built-in support. For the new 
student this takes several forms. The 
Freshman Seminar, for example, provides a 
forum for ventilating problems and finding 
ways to co|^>e, ai well as putting each new 
student in touch with a pee»- counselor who 
has weathered the storms she is going 
through. The students also gfve eatih other 
important informal supj>ort: 

There were times when vou just couldn't do 
some of the thing', ihey would expvct you to 
do. Or vibe you would do ft and vvorfc your 
heart out and your soul out andjhey would 
sav,"\Ve//, that's not right. You missed the 
whole thing!' And you >,u>"lVe//, wh^il am 1 
ifUpposed to he doin^f" 

We'd ha^e group sessions, and we'd look at 
these Lom^lence levels and Iry to figure 
them out together. IVe all worked iogeihvr 
and vVe leaned heavily on our tn^lructors, 
who had to lean on us also. Of lourse they 
wanted AO see what we were doing as 
anxiously as we warited to get ft done, VVV 
really had a hard ttme. 



In addition, tte faculty pays cbse attenUon 
to student expressions of discofwfait and 
stress, alttKiugh t«ie^^l>egin to'soufid famtlfar' 
and even welconw at the dght times. 
They are, after all, among our surest 
indicators when pressure exceeds productive 
levels or occurs out of phase, requiring us to 
lcK)k immediately fmd carefully for ways to 
modify what we are "doing. 

Assessment itself, however, has proven the 
most reliable antidote for the anxieties that ^ 
assessment arouses. At first, the student may 
be overwhelmed by re-reading an avykward 
essay or watching an embarrassing case of. 
nerves on videotape; positive feedback may 
fall on temporarily deaf ears. But repeated , 
assessments soon help her relax and grow 
accustomed to scrutinizing her work 
criticallv. "If you are lacking in a specific 
area, they'll tell you/' one student explains, 
"They'll work with you to improve that area, 
but U doesn'i mean you'pass or fail. That 
tjktfs a lot oi stress off the kids here.— the 
idea that if you don't exactly do it right the 
first time you try again, and you're given - 
s^>ecific thmgs on which you can improve." 
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Gradually, these "areas" move closer and 
cio^r into the stiidelbt's perception of 
herself, as she literally internalizes their 
meaning. Tht< eventually provides the most 
powerful positive feedback of a!!: "t got to a 
point where 1 realized 1 was learning from it. 
After the first couple of months, I really ieit 
that it was doing me g<KKi.'' -^Once you get 
into the system/' a sophomore recalK, "you 
reatiife, 'Well, now Lean do this and do this 
and do this --■ and 1 couldn't when I first 
came here.' " 

This dtscover^ — that what she learns isn't 
poure<J into her, hut is l>eing elicited and 
cultivated from her mvn innate capacities* to 
understand and tod?) often sets in .mf>tjon 
^ a thorough realignment of the student's 
self-concept. She gauis a new way of 
looking at learning and also at herself. '1t 
takes you tliaf whole first s€^mester/' one 
sophomore says, "to gef acc limated to 
cc^ncentraling more* on your skills riitlier 
than just on content. VcniYe just getting in 
touch on your values . . . ofi \hv idea thai 
you do know sonv.Mhing about hufnanities, 
and you do know sonit^lhing aboijf 
environnuMit. " 

'^It's not something you're going mto 
bjincJIy," tmotlior iigrees, "hke yau Uiink it is 
when you first scv tfiiil m.Unx oi 
competences ,uu{ wofidtn, 'How in tlie 
world do I get tJu^e skills^ " A senjor 's 
poignant rc>flrc tiotis sum uf) Mir expc^nenc t> 
of tntern^ih/ing: 



When / came here I thought that everyone 
had the knowledge and I had to find the 
people who had the knowledge in order to 
get brains, education, talent, whatever, Ai I 
have gone through the Aherno learning 
process /'ke struggled through some things,^ 
and I've realized that the stuff is inside me 
and that people can help me bring it out 
and hone it down so its rough edges are 
gone and considerably expand it. 

I think thats what Alverno is doing, they 
pull it out of you. I mean you're kicking and^ 
yelling and screaming all the way, but 
lomcbody keeps pulling th^t stuff out of 
vou. It shocked me to find I l^ve a brain, I'd 
never thought it in a million years. And 
lhat\ what's changed about me, that I 
thought ^'veryone had it and I was the 
dummy. You get that setf<onfidence thing . 
go/ng, it's thv greatest to say, "/ can do it/ 
or "/ think i can do rf," or "If i can't do it 
I'm gn;ng know why." 
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The ime^ting Phose 

By the end of her first yean the student has 
usually been validated nt'the first and 
second levels in nearly all-the competence*. 
She spends most of her sophomore year 
working at levels three and four, and may do 
some fifth level work in competences 
. related to her area oi concentration. Again, 
because most of these levels require 
, assessment in multiple settings, she may 
earn as many as three daivn or more 
validations during the year. By the third and 
fourth levels, however, we have h^gun 
combining assessments: on the initiative of 
either the faculty or the student, a smgle^ 
assessment may^be used to validate for two 
or thre^e comfjctences at once. This practice 
reduces the total number of her separate 
assessments while intrea^^mg the complexity 
of each of them. 

A recent course on the cunifiarative jiistory 
of revolutions, tor example, otiered learning 
exjieriences and assessment opf)or{uniti«fs 
for lour separate comiietence levels 
contemfjorary world, levels ^ and 4, and 
aesthetic response, levels ^ and 4 The 
course began with lectures and discussions 
providing an in-class analysis ot lour i^istont 
revolutions, using an analytic framework 
derived from Thomas C^rt^^ne's C_AOTparative 
Rgyo lutionar v Movements . The class ^ilso 
looked at titf ary and graphic arts from ttie 
' fou) societie under study to see how 
revolutionary change might influence the 
ways individuals derive and express their 
identity as persons. Students then worked in 
teams to identity and study a currt^nt 
revolutionary situation, dividing their tasks 
according to the competence levels each 
team men\her chose to work on. 



Several formative assessments w^re ^ven 
during the first portion of the cour^. Each 
student's fi^nal assessment intlided 
participating in an hour-long panel 
presentation by her team ar^ completing a 
worlsheet packet for each of the lev^s in 
whtch she was seeking validation. Thus, or^ 
student on a team studying South Africa ^ 
made her oral presentation as part of her 
asse3sment for level 4 in aesthetic response. 
First, her teammates on the panel had 
descrited the South African racial situation 
and its causes (level 3 of contemporary 
world), compared the post-World War H 
racial developmerits m the U.S^arui South 
Africa (level 4) and read and discussed a 
poem by the Sduth.African black poet 
Mongane Serote (aesthetic response, level 
3). She then took Serote's poem and 
Comf)ared it to another, by the American 
Langston Hughes, fiointing out the common 
elements and analyzing the differences in 
term> ot the two authors' res|)ective cultural 
and political milieux. She also submitted 
written worksheets for Ihis level, as well as 
tor level 4 o( the c ontemporary world 
c om|>etence and level ^ ot aesthetic 
response. From thts single assessment ^ 
ex|H*rience. she receivtni validations in ail 
ihriH* (ompeteme levels. 

i 
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it IS also not uncommon for the student 
herseINo suggest w^ys of combinifig her* 
jssesscj^nts — Msing a teaching proj^ %he 
develops for an education course^ for 
example, as an opportunity to display ability 
tn several media for one oi her level 4 
communications validations. Instructors 
often urge sophomore students to seek such 
''doubling'' effects. Even the assessments 
admi»i*ilered through the Assessment Center 

. are wcKten more closely into Her classroom 
experience, all but one of ihem l>eing 

. co-de\ignejd and/or co-asSessed by an 
instructor from one of her courses. 

Thgjifiecf of this emph^i^ on combined 
assessments is to encourage the student 
toward ifllfgCAliOK her iearnmg exf^riences. 
As a faculty, we are aware of having 
separated the several competences and their 
sequential levels in order to teach and 
assess them, for the student, keepmg these 

labilities discrete front one another at tir*;? 
helps her to focus on abilities she may well 
have taken for granted and to sf»e fhat they 

, can be analy/t^ and consciously imfmned. 
(Typical is the student already quoted, who 
recalls discovering with e^^c^tement that 
*'you can break it down into all these 
behaviors and parts ol the s^n^ech/' or the 
one who says of social interattfon and 
valumg,* "You know,jaiking to people and 
knowing where you stand just se*emed to mr 
like something pei)ple did automatfcally - 
dfdn'i think about; didn't have to think 

. about. Nlow, however, combining 
assessments gues her a direct e\|H»rumce {)i 



how t^ comp^erKies inte rretate, Sf^ begins 
to realise lhat while st>e has learned lo 
Identify and work on ctevefoping 
abiifties one by one up until now, they 
actually function inseparably in her own 
performance and growth. 

This dawning sense of int^ration is likely to 
emerge first in her understar^iing of how the 
levels in a given competence werk tog^her. 
The cumulative nature of the levels appears 
graphically in the criteria for assessments, 
where each succes«iive level includes criteria 
for the prior levels in loto Oi in summary. As 
her experience of succ^sive assesanems 
brings the meaning ot this repetition to her, 
she is likely to say things like, 'lAfter you've 
mastered the first level and you go on to the 
second, you're stiJf^tioing all the things you 
did at level one. You can't forget it t^ause 
it's integrated so closely in the next level, 
ancj so on it gws all the way down the 
line/' 
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She also beglM iinking ccrnipetencef. 
to^thcr/as she sees oiw ability — say, 
Jnfexring implicit elements (analysis, level 2^ 

— having a direct impact on another — 
such as discerning the Values implicit.in a 
lcchnol<^ical decision (valuing, level 3). 
•Actuafiy/ one student explains, describing 
a faf«er network, ''scxiaf interaction ties in 
v^ry closely with the communications and 
the an«fy^i*^8 the prcAlem solving, 
because yon put ail of them together when 
you communicate/ Or as a nursing student 
ctescribes^ it, *As for the idea of the 
competences, everything is totally integrated 

— in our learning e^^periences at the 
.hospital, in our tests, everything. When 

you're analyzing, you do your social 
interaction . . . it's not what it wa? before on 
«your lower levels. It's a lot fes^ pressure 
because everything you do is very 
intertwined/ 



After lepMled nud^ the student's ; 
toward irUev^iHI Nsr teaming nesceivjis an J 
outright shove at the end of htr s^oiid 
when she p^lctpates In she trtffp-Jrted f 
Competence Seminar (ICS). This half^^ay 
assessn^nt, administered through the 
Assessment Center, specifically focuses on 
her ability to demonstrate in an in^r^ed 
manner the several competences she has 
been developing, Stw ami four five other 
students a,re assigned roles within a fictitious 
group frying to deal with' a civic fXcAlem, 
arui each receives a different set of 
background ipateriai. From the -alternativa 
propo^, each student must make a choice 
and then give an eight minute speech 
advocating her position. Each is then given 
a separate **ln-Basker instrument, in which 
she must sori through a bundle of tasks, 
memos, letters and phone messages that 
have accumulated in her **office* and 
decide which ones to deal with and which 
to delegate. After she has completed that 
forty minute exercise and a rationale 
statement e%pMining her decisions, she and 
her colleagues meet as a group to decide 
which solutions they will Hnplement. > 
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is an intense, compre&sed experience. 
The "Jn-Baskef" is specifically designed to 
incluik several **lorced choice" either/or 
conflicts and has so many elements that not 
every item can be responded to 'within the 
timeframe. The group simufatfon likewise 
operates under firm tinre constraints, and 
during it ea^ h student discovers that she has 
been given only a partial view of the 
necessary information for defining and 
SQlving the group's problem. The ICS 
experience aKo differs sharply from the ' 
pattern of assessment she has become used 
16, in that no specific learning experiences 
in any of her courses have explicitly 
prepared her for the pniblums and tasks she 
^ncounters. The Intepjated Com?)elence 
^ilffinar is thus a whofly external assessment 
in its relation to her prior learfirng 
experiences, and f)redicfably genertifes a 
good deal of anxiety and frustration. 

At the same time, however, the ICS provides 
a valuable insight info how ready the 
istudent is to pufi her abilities into >tegfated 
operation on a new kind of problem with 
the ''real world" t haracienstu *, of not l)emg 
separated neatly mto its elements and nof 
coming as the culmcnation of a series of 
prei^jaratory iearnfng exfienences. It also 
gives her a dramatic exfjenence ot how her 
several abihiies interact. "The sophomore 
year we had to do thrs Mnte^rateci 
Semioar/ " one senior recalls. "You took a 
position', and you had to si»t vour |)nonties 
because you had a sttK k tuli of ihmgs on 
your table. And i thought, Wow' You're a 
woman, and you shoijid apprec iate a 
business person more betaus<» ol all the 
things they have to cio!' And then 1 startenj to 
pull logethff the ditit»fiMi! qualities I 
needed." 



As tf^ growing emphasis on combined 
assessment culminates in the ICS 
experience, students find int^rating 
becoming more and more habitual, indeed^, 
it becomes a dominant mode of their upper 
division experience, "At first," one ?«nior 
recalls, "^everything seern^ separate< But 
when you gel up into the upper division, 
things start to be, put together so that when 
you're giving a speech you're also analyzing 
the situation, you might be problem solving 
, , , you're taking everything into 
consideration. You might not be touchmg on 
ail eight all of the time, but you're using 
more than one. They really do fit together" 
Another senior says, "They bri»ak everything 
apart so that you do get to know yourself, 
* what ^you might value, haw your methcxls of 
mteracting might be. But then by the time 
you get to Jh? a junior or a senior everything 
gets put together and you're putting together 
your values along with your knowledge so 
that you're one })erson, so ymi can go out 
inu) the world and have everything 
together." 
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The Integrattd Compefence Seminar's 
'•unpfepared" externality also in mcHion 
another pattern *.hat hscomes ifKreasingly 
Important durifig the student's third and 
fourth years. It spurs her to begin 
consciously w rjefaliiin g her abifilies 
beyond the situiations in which she has 
learned and developed them. «r so doing, 

. she is making explicit what has been an 
implicit element oi her experience all along. 
Working towards analysis lexel 4 in a • 
philosophy course, for example, she was 
drawing on and extending the analytic 
abilities she had dt?veloped at levels 1, 2 

\and ^ ~ though they might have been 
(yarned and validated in a combinaticm of 
m*^h, art history and Sp nish classes. The 
ICS t>xpi?rienrt» tocuse* ner attention on this 
|ranste< t^ttect by req firing hrr to iunttiun 
etfeclivt*Jy in a >H o .on toreinn lo any ot 
her cours^?; exiHf*" - 



i\5 she begins working more cJosely In her 
chosen area of corKraitration, this tramfer tv 
effect intensifies. Abilities she, ha* (kwii^(mi^ 
in a broad variety of settings^ust no^v be 
brought to locus in a more sharply defined > 
^professional context. This is particularly trOlfc^v 
as she participates in clinical or field 
experiences appropriate to twr profestiion. A ^ 
junior nursing student preparfng care plans 
fur her clients, for example, draws on ^nd ^ 
develops the abilities she has already shown 
at levels 1<4 in problem living, valuing and 
scKiat interaction, ^^ot only r: she 
transferring these abilities from the several 
contexts in which she originally learned and 
demonstrated them, she must '^Iso now 
g<?neraii/e what she has learned from 
working with healthy client f>opulations and 
apply it to the needs of clients suffering from. 
acute illnesses, 

Fof the Mhera! arts sluden! who if. not m a 
proiessional progran^ oH-campus 
e\|>t"fienfiai learntng UKEU fmijects or their 
on-^campus (C)NCEL) counterparts provide 
smiiLu experience in generalizing, ^tvery 
week I fiad lo till out a log," recalls a 
i()-U)iim]er and lornier tnlitof o* the college 
oewspafier. who used \\\v e\{K^rit-rKv as an 
ONC'tl project. 



At the top it said, *Checfc which , 
campeience& you applied h^re," Well, every ^ 
weefc / ch^^ked iust atout every one. And I 
could give specific examples . . . because I 
was obviously using my communications 
skills, obviously t had to analyze^nd do 
probletn solving, and valuing? There's a lot 
of valuing involved in setting up anything 
thai has to do with people and institutions. 
Social interaction? We//, obviously Ukas 
interacting with my staff, / was interacting 
with the printer. , . . Environment? I was 
wojking with the social environment of 
ANemo, and within the physical 
enfvironmeht of the places where we did our 
work. We were trying to deal with some 
current events, and so on. * 

It just made it rr*ally evident that I was 
transferring my abilities, having to write 
jdown which ones I used. 




Predictably, this generalizing pattern extendt. 
beyomi the student's learning experiences, 
on or off campus, and she hearts to use her 
devefoping abiitties in eveiryiaspect of her 
life. ^'You have to look'at it so much that it 
becomes a part ^of you,'* one student says. 
'^Kids around school wiH joke about it, and 
wiit ^y, 'Oh, now she's exhibiting 
withdrawing behavior/ But when I go home 
and somebody says, *Cee, I don't know if I 
should go Here or there' I find myself going 
through all the problem sqiving stages with 
them. Maybe i don't label them, but I know 
where I'm at in each step." 

Npt only do the proces^ies she has learned 
c^rry over, but the habit of assessing her 
own fjerformance and that of others 
becomes gerverahzed as well. **At the end of 
my interaction," an education student' 
reflects, "you always look back on your own 
and s*iy, 'Now did I jdo ih^l right? Could I 
have been more effective? Wh^t could I 
work on iqr next time? What did f do 
extremely yvell?' It's Just become second 
nature, really" "I'm involved in a group 
outside of schoor another student says, 
"and I've been going to that committee 
meeting and I get so disgusted with them 
t^ause it's been ingrained m my head 
about meeting formats and how to start and 
plan your agenda and brainstorm . . . It'*" just 
part of me now and I go to tht*se meeiiiigs 
and it seems !il;e total disorgtini/ation." 



52 



#1 * - ' , 

An impijftant payoff for the sUnient — and 
for tbe faculty as welt ~ comes when her 
generiiHzing of these abilities ^elps her 
handle her life with increased effectiveness. 
*At Christmas,* one senior recalls, * 
^someone was in charge of liturgy and 
wanted to have a sing-alorfg in the 
commons, around the tree. Welt, you hap 
dorm students, you had cash paying 
customers, you had customers with 
tickets . . - 1 said, ^Well, Ann, did you think 
of this and this and Ihisf She just looked at 
me and said 'No/ What am I going to do?' 
And I sat down with her and we effectively 
solved her prohtem." One student recalls 
applying self-assessment during a'critical 
decision: 

I was about to drop out of co//ege because / 
didn't succes^iulty complete some nursing , 
couf^es, Quit - that was my first impuhe. 
didn't succeed in oiie thing, I'm not going to 
succeed in anything/" 

''Well/ I md. "fhat'i wrong." And t guess i 
began critiquing my dec^s/on^ "iiovv is it 
going to affect mv today and lomortowf'' 
Wihen you have to make life decisions, it's 
hard, and naturally you have to critique on . 
how you're dotng this far, how it'^ going to 
affect you in the future. But f don't tfiink 
normally f would have dope that, i do it 
more now than I dtd before I came here. 



The St»fli«cfln9 PhBSt 

The «nal phai* of tht a^trteiKt, » 
student nvws thtxni^ the cdtege^kte 
assessment sysierri, af^MNrs » she becxjmii 4 
an ificfe*i5ii^gfy iclf-dbtc^ learner, TWf 
spacJfJcaliy fostered by the very rmM df c 
assesswnt, even before rfw enters the 
college, in that ^ i& conrtantiy called upoii . 
to asse^tjer ovJn ^reng^hs and weaknesiei 

A senior in management tells of using 
ability to assess her own growth ami neccfa 
and to interpret an environment in choosing 
her senior O^EtVolect. had three 
different places to pick from. 1 picked the , 
problem I wanted to Kilve, the one tbalf was- 
going to challenge me the most and let me 
show my successful management abilities.* * . 

can see it^ln my family,'' another student 
says. *rm always trying tp bring these skills 
home, to stimulate the kids', even trying to 
leach them. I also use it in the hospital, J 
use assessment everywhere. I mean, you . 
can't fust use it here and not use it in other 
^iituations. Once you've kind of mtegrated it, 
^hen you use it all the time/ 
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A» she progresses, she is aiko invited to take 
\ a grater afld greater share o/'ttie ifiiliative* 
in deciding which teaming experiences she 
needs, and in whiiit sequence ihd pace. 
•You sign up for %vheri you're going to do 
your communications level 3/ on.e jtudent 
explains, *ind you dr it in the ctess that 
you choose. Mu^i teachers don't badger' you 
to get il done, you have to take the 
responsibility. But if you rftn into trouble, 
there's nobody s^yin^, *You can't go t<r this 
teacher or \hSi lab irfstfU(;tOf/ You go oui 
and seek her on yo\ir own. H you don't get 
validated, you r^all\ihave nobody to blarne 
but youfseK." "Now "l*rn a junior/' another 
s^ys, **and I nr going to do my s|>eech for 
' cqryimunications, le#t?l 4. You do that tot.^Hy 
on you f own unl<»ss you ask for help. You 
know what your weifknesses are because 
you're constantly assessing VourselL They're 
more or less iu^! feintorcmg'your own 
* assessnH*nt skills/' ^ 



In her upper division won^, the studwt 
participates increasingly in the design of her 
learning exf:^iences rfnd assesscnents. Not 
only does she choose her own OCEL or 
ONCEL >»ite, for example, but she is 
responsible for co-des^igning the assessment 
techniques and criteria by wliich her, 
performance — - both ..er work for her 
employer and other aspects of h«^r learning 
— will.be assessed. **Senior year and even 
junior year,'' one student recalls/ **you have 
to do ail these iirojects and you learn to t>e 
really indepenctent and to be organized and 
to do things on yoifr own. Otherwise they're 
, not goin^ to get done. That's one thing 
^ stressed around here/ "^There are times ' 

when we have to plunge mto things/ 
, another senior adds, "and we don't know 
what we're doing. There have been a 
numl>er nf upper level com|>etences that I've 
done that we had one foo5 on a banana peel 
lis iar a^ guideline^. I mean ihefe's a risk 
tnvoKt^.*' ' 



By the time sht? is facing graduation, 
senior begins to project tbese selMirecting 
liabils into her int»vitable musings about her 
future career. think we're always going to 
ije asse*»sing ourselves/' one nursing senior 
says. know iiu\i I leave the floor at 

the end ai the d»iv, I'" ^^^'^t^^* myself notes 
just to make sure I've done everything/' 

''Assessing has heiome sucli «i f)aTt ot you/' 
another reflects, tfiat it's something you're 
goin/ to do your whole liie. I \erv tune you 
do sonuJiing. (h when you're about to do 
somefhing, you're j^ning to think .iboijt it. - 
And «itter it's done you'll say. "Well, what 
did I do welk What did I do wrong^ You're 
gf)ing \o lise if e\er\whefi» m your 
nursing, in youi aft in voyjr m.un.ige. It will 
be integrated into our lives." A third stiKlent 
. stjms ft up In s.!ving, "Voti'rc^ vf)Uf own 
prFsate AsspssnnMii ( <»n!^M by the lime vou 
■get oul of hef :v And ycni i afi und \nH)p\v 
yoiTneeii to lu^lp von. Vrui u(\Ue s<H,if own 
rt^ourc es. 



For the student who has realized the full 
bcMiefits oi thr assessment experience during 
her college years, assessment has become 
an integral parf of her learning just as 
learning has lK?come an Integra! ^lart of her 
lite. "Now I know/' one senior,,says, *ihat 
there'll never l>e a tnne when Til stop 
learning/' "Somewhere along the way I 
changi»<i mv attitude/' another says, 
"Assessment - learning -- what's there to^ 
he atraid ol^ It's .dl o cfiallengc\. your own 
[HMsonal devc»lopnient/ It's tun^" 

' ;'n> not so worried about comparing myself 
!o llw? next [KM son/' another senior adds. 
<ompare mysell to myselL As long as I kROvv 
what to to I'.Mfn, that's nnportant/' "I 
usini to .ipproach it'<uning w^tli a lot of 
tear/' another sjvs simply. "Now I know I 
( an m.ikc* the most ot it'"* 



Y HcNfitfe Develop Our Assessment Syirtem 



Often during the last few vears/we hdve 
been a^ed such questions as **How do ypu 
set up an assessment 5»ystemr' or "What is 
the (K^nizatronai structure of Alverno's 
^^^lege^^de assessment program^" We have 
even asked ourselves whether we could 
describe otif model in overall terms, and 
have tried Co do so, The more deeply and 
seriously we have reflected upon such < 
questions and upop our own experience, 
, hpwever; the more we h«ve lx*come 
convinced that our most im^)ortant learning* 
has been to see our ' syvtem ' as a constantly 
evolvmg proiess rather th^^n as a structure. 

When we first hegan our exploration into 
assessment, we looktHl fLir jnri y^nU' tor 
anvone who had dealt with the problem ui 
developiq'g assess^Tlent tec hniques. 
. Collaborating with \hv creators oJ .uMdennc 
assessment f)rjittciN, nast enf programs m 
the fffofessions and several wrll <{evelop<uj 
business assossfneni centers, we discovered 
that the most unusual as|>t»cl o! what w(» 
wert» attempting w.is c>ur mtejiluin tcj use 
assessniefit as a mafor developmental 
t ^-jK^fierue in tfu^ ItMrning proc ess 

Enifjloyers. eiiuc ators and c U'dt ntialmg 
agent K»s valued assessment* a«^ ^ wav 
looking system.Ufc <illv at "reahs|1< _ ^ 
i|.K?rtarma.nce al)ihl}es (iin^ctlv -relatefi t<j the 
fol) role c^f f)rolessi{)n In rt»sponse to \hv 
neecis ot tfieir en\ ironnifnt'-, assessmefils 
were often hetnv; n^vd puk h \\kv Ifaiiilional 
tests tor idenlilving, c(»rtifving ,\\ui sorting 
candidate . Iht^ niou^ vm- and other 
assessmerN.iJ'ev elopt^fs beu^ui lo use 
assessmtMil as an ifilt^gral pari nt tlie 
individii«d's on;y)ing learning, hnuc^ei tlu* 
more complex the* t^«;k htu anu* 



Tor one thing, the sha?r si/:e of art 
assessment sy^m designed" to •follow 
several hundred feSfnera through- four years^ 
of their development so far^'exceeded 
anything^fhen in existence that it was no 
more fjpssible lo describe in meaningful 
det'iiii,than an unexplored continent. In " 
acldition, our commitment to liberal 
education involved us in assessing a broader 
range of abilities than most previous 
assessment ventures had needed to deal 
with. 

Even more important Was the fact that in a 
developmental context the gqaJ is to create 
a syq^^m responsive and flexible enough so 
that each assessment provides the maximum 
fjqssible msight into the individual iearner's 
p'^ogK^ss. Altfiough intake Jl^^ssments may 
he iairly sfandardf/cxl sand universal — as is 
our pre-entry Assessment Day — each 
'student's pr{?gress beyond that point will 
nec essarily 'tend to [)econie niore 
fndnalujIf/iHi. Because the mtt^i 
assessments rtneal an individual's f)articuiar 
strengths and weaknesses and learning style, 
her pattern ol course's and learning 
experiences can be selecteci to suit her 
partKiilai ncHxis. Sul)sfHiuent ass^essments 
musf; m turn, rcMiecl ttie indjvidual pattern 
o! IcMrotng c»\periencc*^ she lias engaged in, 
and thi^ de\ eh)pm«*n!al goai> tor whu fi 
tjiost* expenences were* fifsigneci. 
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In our developmenla! use of assessment, 
moreover, we specifically wanted |he entire 
learning process to become more and more 
learner-directed. This gi»al, too,- affected the 
nature of the assessment systt?m. We had 
already learned from the designers of 
business assessment centers that it is critical 
to inform each candidate beforehand of the 
purposes, methods and criteria of the 
Assessment and to provide detailed f^ersonal 
feedback afterward. Extending thii process 
to train the learner to select her own , 
learnmg experiences and assessment 
'situations and to assess herself ; 
augmentcHi the need for a responsive, 
flexible system. 

Finally, our develcjpmental emphasis 
required that we take assessment as 
seriously as we ask students to, and that we 
rely on if as a pnnlary source ni tt-edbac k 
on our goals antl efforts as eriut ators. 

f reqiicntly, a pattern ot siudt'nt dinituitv 
with part ot an assessmt-nt leads instruUors 
to redesign tht-ir instruments, from time to 
tmie, a. pattern of unsuciesstu! validation 
attempts rt-vcais a failure to teach as well as 
J taiiurt- to learn, and pronrpts a rethinking 
of a learning experience or a whole course. 
Thus, tor example, the f reshman Seminar's 
learning expenenci- 'of level ! o! the 
environment and contemporary world 
competences have be<-n tliorougtily 
•reworked, along with the assessment 
■ situations themselves, in response tt) student 
■ difficulties that emergi^i ui tiiose 
, assessments. 

' Ctjnversely. successtul and Creative student 
{H'rf»>rmances are among the most graiitymg 
forms dl feedback tor tac uitv. Consistently 
mipressive pertormanc es on an assessment 
have on suveral occasions em ouragcd 



instructors or departments to.extend the 
offerings in a given course'to include mote , 
advanced levels of a given competence of to 
embrace additional competences, ^ ' . 

Using assessment develppmentally in 
undergraduate liberal education, then, 
means that each of more.than a thousand 
students spends four years pursuing a 
personalized learning path. Each instructor 
or department designs and mcxJifieS 
assessments to fit the learning experiences 
within each course, and the learning 
, experiences also change from semester to 
• semester. Upper division students regularly 
engage in independent projects or in field 
experiences shaped by needs and 
opportunities in the community, for which 
learning -and assessment plans must be 
adapted or improvised. And throughout her 
progress, the student pb'ys an increasing 
role in selecting her own learning 
exfieriences and assessing her own 
[)er1ormance. 

A developmental system ot such scope and 
constant flexibility i^oes far beyond any of 
the assessnu-nt systems developed before we 
Ijt'gan our work. Nonetheless, to manage 
such a system the faculty must be able to 
assure that its fluidity operates within a 
unified, coherent tramework, and must be 
able to maintain certain levels of 
courdinalion and quality. 



Dements of 3tobiiity 

The esseritial precondition for maintaining 
.-tM^^'coherence and quality control is faculty 
comens^. Without the months and years of 
open discussion and debate, experiment and 
reflection, brainstorming and critiquing that 
went into the initial defining of our renewed 
commitment to liberal education, any 
attempt to develop an assessment system 
would have been futile. 

The original dialog between the faculty a. id 
its academic task force has taken more 
stable forms now. But the commitment to 
Friday afternoon workshops and regular 
faculty/staff institutes coordinated by the 
Faculty Development Commirtee remain**, as 
a concrete way of maintaining the free flow 
of information and dtstussion we need to 
keep our consensus intact and vital. That 
commitment's depth is reflected in the 
intense competition each semester among 
faculty teams, departments and committees 
and support offices eager U: share their work 
with their colleagues. 

The most imp^irtant smgle outcome of our 
faculty's hard-won and dynamic consensus 
is the curriciitum ftseif. The curriciiium, as 
an integrated matrix of developmental 



experiences, also provides the stron^t 
framework of stability for our assessment 
system. Because the curriculum is by design 
coherent and unified — rather than a .t 
collection of programs designed for 
disparate goals and often working at 
cross-purpwies — it could and did give ri^ 
to ^ coherent, unified assessment system. 

This coherence and unity also make it 
possible for us to encourage students to 
pursue highly individual paths through the 
curriculum, since its developmental logic 
|.K?rmeates every course and program. We 
have indeed managed tp approach a 
situation m which, as one faculty member 
put it, "the student bumps into what she 
needs next whichever way she turns." 

Working from consensus, we have been able 
to progress steadily but unhurriedly toward 
generic assessment techniques. These can 
provide an important unifying framework 
within an assessment system, but they couid 
never have been successfully miposed nor 
could the process oi their discovery be 
abridged without vitiating their meaning. 

C^)iiaU)ratmg on our common venture we 
funo come to perceive the patterns 
un(ierlyin>^ our sevc^rai disciplines' 
jipproathe^ to a given competence, and 
(lave discerned basic unities within the 
(jiverse assessment technic^.^s invented lc:>r a 
given level by various instructors, Gradually, 
with careful testing and faculty teedback lor 
ffniesi^n, we liave been able to offer more 
«nid nunv generic c riteria and even 
tomf)lete instruments that can he used 
etteclivelv - with af>pr(?pnate acJar tations 
and au^mentiilions throughout tne 
College. 



This work of mbnitoring assessment 
Tgshniqueb for comparability of meaning 
and aeyeioping generic instruments and 
criteria is a major responsibility of the 
Assessment Committee. This body, with 
representatives from each Competence 
Division, the Assessment Center and related 
support areas, is charged with overseeing 
the entire assessment system as it evolves. 

The work is also carrFt?d on simultaneously - 
in several other areas. It Is a continuing part 
of the collaborative work of each academic 
and professional department, and like>Mse of 
each of*the Discipline Divisions into which 
the departments are organized. Each of the 
eight interdisciplinary Comjjetence Divisions 
' also ha^ a major responsibility to review 
assessment techniques across disciplines (as 
outlined in Chapter Two above) and to 
operate as clearinghouse, coordinator and 
generic designer. 

External assessment techniques also provide 
^ a valuable stabiliv^ing element in a 
developmentally lluid system such as outs. 
As with the generic techniuues, external 
assessments could not haw been 
meaningfuiiy imposed at the outset. They 
have evolved as \he ftlcuhy grew more cind 
more convinced that the externality inherent 
-m all oljr assessments could aful should he 
extracted;' as it were, in a purer torm to give 
us greater access to outside perspiHlives on 
a regular basis. 



Assessors may be drawn from outside tte 
course or learning experience or from ^ 
off-campu§. The- ciiiire asses^ent situation^ 
may be administered outside the course 
setting as are those harKlled through the 
Assessment Center. Perhaps the most 
concentrated dose of ext^nality comeit in 
assessment techniques that are not designed 
as the culmination of any course or learning 
experience, such as the pre-entry assessment 
battery for level 1 of i:ommunlcations r the 
integcated Competence Seminar at the end 
oi the second year. 

Wholly external assessments like the ICS, 
however, require great restraint. Such an 
assessment's value to the faculty as an 
outside "check" on what is beinj^taughf and 
learned must be weighed against its 
tendency to be of limited developmental 
value to students, who ex|>erierice it as 
st)mething for which they have not had 
adequate learning and with which they have 
no lurtiier opportunity to work once they 
have taken it. For this reason the initiation 
and design ui the ICS and any smiilar 
instruments lies with the Assessment 
Committee. 

As the Competence Divisions review their 
respec tive competences, the Assessment 
Committee regularly reviews the "whole 
[)icture" across departments and disciplines 
and among the several comf)etences. It is 
their task to see that a |X)tential!y important 
de.* 'moment in one area is disseminated — 
even in-fore a lullef fejX)rt in a forum like 
the UKuKv/stalt mstitute into other areas 
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wfwc its impact rrtay be important. They 
ar&o work to matntatfx a general consistency 
of ctetelopment throughout the system so 
that no one area or element slips out o( 
fo£us, as in thei*- recent effort to encourage 
wtder use of oral and multrrmedia 
assessiuents throughout the college. 

Qenienrs Of Change 

The Assessment Committee's most imf>ortant 
responsibility, however, is to carry on a 
constant rethinkir.;^ of our goals and our\ .\ 
progress towards them and to seek out and 
nurture any promising new avenues of 
inquiry or insight, lust as the Competence 
Divisions do with individual competences, 
the 'committee members work constantly to , 
pull together what wt» have learned about 
assessment and its contribution to learning 
and how we might wish to alter or augment 
our overall assessment system. In this role, 
the Assessment Committt^e functions r^ol 
■^onfy as an agent of synthesis and coherence 
but. also as a source of continuing fluidity 
and change. 

A significant instance oi this arose recently 
as lifdivtdua! departments Inpgan to 
cTystalli/e some patterns they were seeing in 
student penorrnance on advanced 
assessments. As student^ neared graduation, 
instructors in every ,m>^ found themselves 
facing the question ot"how to r^iake 
.verifiable distinctions among student 
performances, cmd t)etween those that were 
successful and those that were outstanding. 
What criteria, they asked, were they really 
using in s^>nsing and agreeing on such 
distinctfons^ 



In the mathematics ar^i biolc^ 
departments, for example, instructors had 
begun to assess for ^indepeqctence/ On 
assessnjent record.s drafting criteria for eacfi 
step in the scientific problem, solving 
m^had, biology assessors were also noting 
whether the step was student-initiated (^1), 
faculty-initiated (0) or required repeated 
faculty intervention (-1). Tfie ntath , 
depa/tment had developed a ten-point scale 
fpr rating the independence of a student's 
work in each of five areas ^definition, 
a^dom, theorem, computation/ application). ^ 
Other instructors were making similar efforts 
to become explicit abouf their aoparehtly , 
intuitive judgments in discriminating among 
successful performances and describing the 
^rsonal styles *of individual students. 

Aware of these and related concerns and 
their iKJtential implications, the members of 
;he Assessment Committee were working to 
..define the elements that distinguished 
advanced-level learning from a student's 
earlier development. At the yeaf-end 
institute, they shared their work with the 
faculty and staff on defining six 
"characlerfstics of advanced student 
perform^jnce." - 
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These represented qualities — int^ration, 
independence, self-awareness; creativity, 
connmitaierrt and habituality — that seem to 
stand in relation to competence as an 
adverb does to a verb. Thus, they reasoned, 
a student might demonstrate her Ability to 
**take a personal position regarding the 
implications of contemporary events" 
{contemporary world, level 6) or to "lead 
organizational activity effectively" (social 
interaction, level 6) and be validated. But 
she might further be identified in terms of 
how seif-awar? she was about the 
techniques she used in her leadership, or to 
what extent slie integrated her »iitands on 
particular issues withm a coherent personal 
framework. 

Using the remits frbm small-group 
brainstorming sessions with the whole 
faculty and staff, the Assessment Committee 
returned to work on the c haracteristics to 
break out their modes uf appea-rance at 
different levels of student development. 
Work on the ^'advancinJ characteristics" \^ 
still jn its early stages — but clearly this new 
exploration wiM make a salient contribution 
to the future shape of our assessment * 
system. 

Nor is the Assessment Committpc the only 
institutionalized agent for change. At every 
other level as well, from the Competence 
. bivision«^ lo the individual faculty member, 
the process of pulling together what has 

learned mevi^ably suggests new 
questions and directions and the solution to 
x>ne challenge almost always poses others. 



This intertwined pnac^fss can even be seen 
in the work of our Office of Evaluation, Th« 
office was created as a pernjarN&nt means <d 
enabling us to stai^ outside our own 
assumptions and continuaify critique the 
relevance of our educational goals arid the 
effectiveness of our methods. Dr«wing on 
diverse instruments and, techniques for 
assessing human development, cognitive, 
and other skills and various modes of 
learning, the Office of Evaluation staff 
conducts a number of cross-sectictfial and 
longitudinal studies uf our students' 
deveiopnient according to standards. and 
measures other than our own. 

They also design and administer intensive 
interview techniques for eliciting student 
perceptions and attitudes during their years 
here, and maintain an ongoing program of 
comparison testing among assessment 
instruments from throughout the college. In 
addition, they are conductirj^ studies of 
rutstanding professionals in several fields 
and have planned follow-up studies of our 
graduates as means of checking the value o 
our curricuhj?n and competences to the 
professional woman. 
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TI*iition Aivoutd suggest carrying on such 

as far oulstde the coileg? as 
^|)6ss4ble From the first, however, we 
]ir•aU^ed that existing measures apd 
jij^icrimentaf designs would need serious 
modification for use in evaluating our 
non-tradition^t mettKKis. The Office of 
Evaluation rfaff would therefo^^ need to 
have as thorough an understanding of our 
methods and their rationale as any faculty 
member. It « iso sooii became clear that as 
* Our untferstaridihgs and.methods continued 
to evolve, the evaluation team would need 
to be intimalely aware .of the'changes in 
order to keep tlieir monitoring up to date. 



As a -result the Office of Evaluation has 
operated from its irKef^ion ai» an integral 
part of the college, arnJ in voltaborating w{tfi 
faculty members to design arui revfse their 
own studie<i the evaluation teani has made 
innumtfrable contributions to the faculty's 
thinking afKT planning, As they are 
completed and! published, the Office of 
Evaluation's fe];K)rts wilt be as valid and 
objective as the best research stills can 
malce them. Even while they are being 
carried out, however, the office s monitoring 
and evaluation efforte exert a strong and 
invaluable creative influence on our 
currfculum in general and on our assessment 
system in pellicular. 



A Hei^stlc for Develophg Systems, 

Because constant evolution of thife sort is not 
only inevitable but desirable, and because 
each faculty's best effort to asjess their 
achievement of their educational aims will 
necessarily result in a unique syMem, we 
i-have concluded that the most useful model , 
we can offer is not a detailed chart of our 
own organization or the flows of process 
Within it. Instead, we feel we can best share 
what we have learhed-by offering another 
heuristic this time hot a mode^, but a - ' 
series of questions indicating dynamics or 
elements which we have found essential to 
the development and ongoing growth of our 
assessment system. 
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Wfrit h yWf 4i*k<^^ VVhote faculties, 
/ even at a smali college, are too large to do 
much of tte detail work that must be don^ 
in b^inging-'new conceptions into clarity and 
clarified ideas into reality. Committees and 
task forces arc loo small to think of all the 
relevant possibilities or to generate and 
maintain faculty-wide consensus. Some s<St 
of ongoing dialectic was the dynamic we . 
fourid essential for accomplishing all these 
goals simultaneously At one point the 
dialog was president-faculty, then it was 
largely task force-departments, and now it 
occurs in numerous modes (Competence 
Divisions-individual faculty Assessment 
C6r'iVfl^,tee'Competence Divisions, any 
group-whole faculty via workshops and 
institutes, etc.). The creative dialectic can 
take a protean variety of forms; but if it isn't 
there, nothing happens. 



Af^ aB vmif lieflnitiow We are 

cqnstantly astonished at how perishable ^' 
insights prove to be. No matter how 
carefully we formulate our umterstanding 
about one element of the sysiem^ within a 
year or two the things we learn in c^her 
areas reshape that summary's meaning so 
that it looks at best incomplete, at woret 
positively inaccurate> Not one of the 
competences or its constituent levels, ool 
one of our statements of committee duties or 
priorit^es^'^not any assessment technique or 
learning e?<perience doesn't soon need 
revising or rethinking. Everything can't be 
rethought at once, of qourse; and some 
revisions are more urgent than others. But 
any time a statement or a set of criteria 
mcfre than a year old looks as good as it did 
^ the day it was written, look again. 

What are v ou tr vinit ISLJSKSSJ Whether we 

are rethinking some part of the existing 
system or wrestling with a new probleni, we 
always find ouselves back at "Go.'* We 
simpSy cannot work effectively with any part 
of the assessment system until we have, 
carefully stated, (or restated) which outcome 
it is supposed to help us assess. Often, when 
we reach a roadbiock in our thinking, we 
find that it is because we are realty as far as 
the old statement of \he outcome will take 
us, and we are readier than we know to 
restate it. 
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WfiQ are Your ati€f§ment ^natufati'^? 

Assessment isiVl a field in which anyone has 
trained expertise, not even measurement 
psychologists. But your system will demand 
the whole professional effort of at !easi of¥s 
or two people who find that they actually 
enjoy reading, wrMing, eating and breathing 
assessment. We have found home-grown 
talent to be essential here, particularly in the 
earlier stages. It would be futile to import a 
system or follow an outside expert's 
formulations: you can only assess what you 
mean tc teach. At some pKJint, your faculty's 
assessment specialists will find themselves 
diverging from whatever professional paths 
they had been following to shepherd the 
system's growth. But if they are indeed 
•''naturals," they won't mind, 



Have vou looked at the nrhote ok^r^ 
QKfiJyi The process i>f^thrrU(ing through 
and planning any part of the system — or ol 
successfully designing and carrying out^n ^ 
assessment that reveals ^nuine learning 
progress — can be both engrossing and ' 
rewarding. Wfe have had to remind ourselves 
at every level to keep looking at the ovei^ii 
view, to reevaluate goals afjd directions, to 
pay attention to the total ''shape" of what 
we are doing. This is a critical job, and : 
because it dc^n't always seem pressing it 
.needs to constantly reinforced as a 
priority. But we have found that it pays some 
of the richest dividends in helping us realize 
our accomplishments and ffnd promising _ 
new avenues of devetopmenl. It can also 
help stave off cumulative errors ^r 



omissions. 
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Llkc/anything worth Boing, developing an 
assessfjnent system {or any part of it, even an 
individual assessment technique)^ isn't easy. 
.As an- dngoing system, assessment makes 
demands on student and faculty time that 
are roughly equal to what they were under 
traditronal testing. But we have made an 
ertormous investment in faculty time and 
energy over the past decade to develop the 
system, and the ongoing corporate work of 
evaluating, assessment — both the several 
instruments and the whole system — 
represents a new area, of faculty 
responsibility. 

Besides the quantity of effort, our 
exploration into assessment has also 
required a new quality or kind of work from 
us as a faculty. Setting aside our accustomed 
commitment to the most thorough po'^sible 
discussion and academic debate, we had to 
commit ourselves to active ex^ieriment. We 
' had to ^ agree to agreed to move forward 
and work With a livoabie plan oven though 
many of us might harbor^ res^Aations and 
.uncertainties, in order to gain some concrete 
experience to learn from and improve upon. 
We had to deny ourselves the luxury of 
standing at an impasse, in the mterest of 
making at least an honest attempt. 

We feel certam, however that the benefits 
fiave already outweighed the cosS. The 
assessment system itself, in what it has 
already contributed to our students' 
. learning, 4ias proved bevond price, in 
addition, we have gained as a faculty. We 
are much more able than ever before to 
work openiy and effectively as colleagues, . 
without regard to statirt* or discipline. We 
have come to rely so habitually on a 
constant, collaborative sharing that our 



unusually full schedule of workshops and 
institutes never completely satisfies tf^ 
demand. We are learning how to fall, to 
adtnNt failures and even to share thein so 
they can be learned item. We aie thus also 
gaining a confidence that gives our teaching 
more authority and more flexibility than .our 
students used to be able to expect. 

tn writing, this all sounds much more clearly 
planned and organized than it ?ver was, is 
or will be in experience. Our exploration 
began as a college-wide effort because' we 
were confronting a college-wide r^hinking 
of our mission and our goals. It migiit just as 
easily have tegurt in a single department or 
division or professional program. Where we 
feel we have succeeded is in discovering — 
and learning some of the ways to maintain 
and nurture — a dynamic process of 
development. ^ 

' At the heart of that process is the willingness 
to risk. Most of our learning has come from 
experience: we have never yet been able to 

, foresee and predesign nearly as well as we 
can understand and modify afterward. The 
wisdom of hindsight is priceless, but there's 
unly one way to get it. As one faculty 
member put it, we couldn'^ begin working , 
on, our future until we took the leap that ' 

^ brought It into our present. 
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